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PREFACE 

This Review and Synthesis oj Research on Individualizing Instruetion 
in Vocational and Technical Education is one of a series of “state of the 
art” papers in vocational and technical education and related fields. Vo- 
cational educators have always been concerned with providing the opti- 
mum educational opportunity to each individual. Much research also 
has been concerned with this important priority topic. This publication 
should assist in identifying substantive problems and methodological 
approaches for researchers and curriculum development specialists as 
well as providing practitioners with a summary of rcscaich findings that 
have application to educational programs. 

This review is intended to be an authoritative analysis of the 
literature in the field. Those who wish to examine the primary sources 
of information should utilize the bibliography. Where ERIC document 
numbers and ERIC Document Reproduction Service (EDRS) prices 
arc cited, the documents arc available in microfiche and hard copy loims. 

The profession is indebted to Joseph Impcllitteri and Curtis Fineh 
for their scholarship in the preparation of this report. Recognition is 
also due David Pucel, University of Minnesota; J. William Ullery, Tech- 
nical Education Research Center, Cambridge, Massachusetts; and Frank 
Pratzner, research and development specialist at The Center, for their 
critical review of the manuscript prior to its final revision and publication. 
J. David McCracken, information specialist at The Center, coordinated 
the publication’s development. 

Members of the profession arc invited to suggest specific topics 
or problems for future reviews. 

Robert E. Taylor 
Director 

ERIC Clearinghouse on 

Vocational and Technical Education 
The Center for Vocational and 
Technical Education 



INTRODUCTION 

This particular review and synthesis document may be of more 
interest to some readers than to others. Not everyone will agree with 
the approach which has drawn rriatcrial from many areas which arc not 
specifically within the field of vocational and technical education. This 
particular characteristic, however, may make the publication even more 
meaningful to a larger audience. By identifying reports which deal with 
individualized instruction from a broad conceptual base, it will help 
vocational educators to examine their research activities in light of the 
work conducted in other settings. 

In the reporting of individualized instruction research and develop- 
ment activities priority was placed upon investigations which dealt with 
instructional problems within the general parameters of vocational and 
technical education. Other studies were discussed outside those parameters 
when it was perceived to be necessary for a i.nore adequate coverage of 
the topic under discussion. Individualized instruction efforts in areas 
highly related to vocational and technical education (military training, 
industrial training and other areas of education) were thus included. 
No attempt was made, however, to prepare a thorough review of research 
in those related areas. 

The materials used in this Review and Synthesis were gathered from 
several places. A number of useful reports were identified through the 
computer search conducted by the Educational Resources Information 
Center (ERIC) Clearinghouse at Ohio State University. As a result of 
contacting state Research Coordination Unit directors, several other 
meaningful items were obtained. Dissericition Abstracts served as a 
prime source for relevant doctoral theses. Contacts with key personnel in 
military training research resulted in the inclusion of many meaningful 
research efforts from this sector. 

Appreciation is expressed to all those persons who contributed 
materials for inclusion in this review. Space limitations do not allow 
each person to be listed by name. Specific thanks must be extended to 
Richard and Cheryl Gumaelius. Their assistance in locating materials for 
this document is appreciatively acknowledged. 

Joseph T. Impcllitteri 
Curtis R. Finch 
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OVERVIEW 



Historical Perspective 

One might say that individualized instruction had its beginnings 
in the minds of early philosophers. For example, the Greeks had some 
idea of the consideration which should be given to an individual in the 
educational process. Plato envisioned society as a place where people 
would learn well that which they were fitted for by nature (Nash and 

others, 1965). Aristotle, who was a pupil of Plato, carried the concept 

of the individual even further. He desired an educational system that 
would allow an individual, in association with other persons, to guide 
all his conduct by reason (Wilds and Lottich, 1961). Many other well 

known persons contributed to the idea of individualistic education. Jean 

Jacques Rousseau presented his case with the publication of Emile. Not 
only did Rousseau specify in his book that experience is the best teacher, 
he also indicated that the nature of the youngster is the center of edu- 
cational inquiry (Bennett, 1926). Similar views were expressed by 
Friedrich Froebel who advanced a unique educational theory during 
the early 1800’s. Froebel emphasized the individuality of children, and 
felt it important to recognize their dynamic qualities and to integrate 
these qualities into the educational process. 

The aforementioned teacher-philosophers relate to a common theme, 
that is, providing consideration to the needs of the individual within 
the instructional process. It is, however, important to recognize that 
current conceptions of individualized instruction may take on a some- 
what different structure, particularly from the standpoint of compre- 
hensiveness. 

What factors then seem to contribute to the current view of indi- 
vidualized instruction? Gibbons (1970) in discussing the origins, the 
nature, and the contemporary status of individualized instruction, does 
a thorough job of identifying these factors and classifying them in a 
meaningful context and the reader is urged to examine this recent article. 
The attempt to encapsulate briefly herein the major points brought out 
in Gibbons’ article cannot do justice to the magnitude of his effort. 

He lists nine types of individualized instructional approaches which 
have emerged during some point in the history of American education, 
and concludes that, “individualized programs have been part of American 
formal schooling almost from its inception, and the revived interest in 



individualization has taken a bewildering array of forms.” The approaches 
to which he refers are: 

1. Tutoring. 

2. Correspondence courses. 

3. Self-paced unit plans — the Pueblo Plan, the Dalton Plan, the 
Winnetka Plan, Individually Prescribed Instruction (IPI), the 
Nova High School independent study program and Project Plan 
(Program for Learning in Accordance with Needs). 

4. Programmed and computerized instruction. 

5. Independent study programs — the Trump Plan and the Montes- 
sori Method. 

6. Grouping for individualization. 

7. Administrative plans. 

8. Personal programs — Neill, Erickson, Friedenberg, Goodman, and 
Holt. 

9. P.emediation and teaching exceptional children. 

It appears that several movements and programmatic efforts have had 
an effect on individualized instruction as it is perceived today. Among 
them are the progressive education movement, the work of Skinner and 
others with emphasis in the area of programmed instruction, the in- 
creased thrusts in the area of educational technology, and concern with 
the identification of objectives in behavioral terms. 

Although one might not be able to pinpoint exactly how the pro- 
gressive education movement evolved, it appears that the influence of 
early educators and philosophers such as Rousseau and Froebel had a 
great deal of impact. Likewise, the efforts put forth by Francis Parker and 
John Dewey cannot be discounted. Their contributions to the foundation 
of the progressive education movement are indeeed impressive. Perhaps 
more important than the identification of persons who contributed to this 
movement is the identification of what aspects of progressive education 
are relevant to individualized instruction. Although there are different 
schools of thought, a key precept is that individual differences among 
children must be recognized (Atkinson and Maleska, 1962). It might be 
said that this idea had at least as much impact cn educational change as 
any other specified in the progressive education concept. 

One outgrowth of this concept was the Winnetka Plan, of significant 
consequence to future individualized instruction efforts. As Lindvall and 
Cox (1969) point out: 

The Winnetka Plan for individualizing instruction represents a 
landmark in the history of the development of individualized 
programs which has served as a point of departure, or at least of 
comparison and contrast, for many subsequent activities in this 
area. ... In brief, the Winnetka Plan was a procedure for the 
individualization of instruction involving carefully specified se- 
quences of instructional objectives, tests to determine pupil 
mastery of these objectives, instructional materials for use in 
achieving each objective, a procedure for developing individual 
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lesson plans, and a procedure for monitoring pupil progression 

through the curriculum. • i j-r 

Another important effort in the attempt to recognize individual dif- 
ferences in school programs was a movement which emerged during the 
1920’s to develop something called educational engineering (Finn, 1968). 

The leader of this movement was W. W. Charters Charters 

ideas were attacked and pretty well demolished during the 
thirties by both the social reform and the child-ccntcrcd phil- 
osophers of education. From the middle fifties onward, the 
Charters’ concepts were revived, although in a new form, and 
were seldom attributed to him. 

The concept revived in the fifties to which Finn refers is the systems 
approach,” currently a strong force in the design of instruction. 

Another thrust which seemed to provide a more comprehensive base 
for the current idea of individualized instruction was the work conducted 
by B. F. Skinner and his associates. Skinner’s extensive research with 
teaching machines, programmed learning, and the application of reinforce- 
ment principles to education have undoubtedly affected the characteristics 
of individualistic education. His work and the work of others reflected a 
shift of emphasis from lock-step education to instruction tailored to meet 
the needs of individual students. More consideration was given to the 
differences among students with regard to such variables as time necessary 
to complete instruction and prior knowledge. Additionally, more emphasis 
was placed on reaching a certain specified criterion rather than identifying 
where a person might fit along an artificial continuum. 

Concurrent with the work of Skinner, a great deal of emphasis was 
being placed on educational technology as it fitted within the school struc- 
ture. With the advent of computers and other sophisticated learning de- 
vices, a reevaluation was made of the actual role of the teacher within the 
instructional environment. 

Lastly, concurrent with the movement toward increased use of edu- 
cational technology in the teaching-learning process, a strong effort was 
made to identify objectives in behavioral terms. The increased emphasis 
in this area can be, at least in part, attributed to the publication developed 
by Mager (1962). In this document, he outlines several characteristics of 
behavioral objectives which, with minor variations, have remained un- 
changed in texts which have been produced since that time. 

These movements or efforts then, have been generally associated 
with the trend toward a more comprehensive description of individualized 
instruction. It is this broad-based definition which this document will use 
as a framework for the topical headings that are provided. 

The Concept of Instruction 

In order to identify a truly comprehensive concept of individualized 
instruction, it is first necessary to review the concept of instruction and 
identify the work which has been done to specify elements which underlie 
it. Although a general description of instruction may consist of imparting 
specific knowledges, skills, and attitudes to others, for the purposes of 
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this document some of the more comprehensive definitions should be 
examined. It is, therefore, in order to review several of the more recent 
theories and models which have been designed to interrelate the elements 
that constitute instruction., MacDonald and Leeper (1965) discuss a model 
which incorporates an instructional system and a curriculum system. They 
distinguish between curriculum and instruction as two separate action 
contexts, with curriculums producing plans for further action and instruc- 
tion putting plans into action. They feel that curriculum and instruction 
interrelate with teaching and learning to varying degrees and, therefore, 
must be taken into account in an educational design. The space within 
which curriculum, instruction, teaching, and learning overlap constitutes a 
point of congruence where curriculum goals are operating in instructional 
settings through effective teaching activities, as evidenced by changing 
behavior or student learning. “Instruction is differentiated from teaching 
in that instruction encompasses more of the situational elements. Teaching 
refers primarily to the human interaction between teacher and pupil” 
(Association for Supervision and Curriculum 1‘evelopment, 1968). 

Theorems for a theory of instruction are proposed by Bruner (1966). 
The author takes a somewhat scientific approach in setting forth some 
basic propositions about instruction. He indicates that a theory of instruc- 
tion should specify the optimal experiences that predispose a learner to 
learn — it should relate to the structuring of knowledge that is optimal 
for comprehension; it should specify optimal sequences of presentations of 
•' .aterials to be learned; and finally, it should specify the nature and pacing 
of reward and punishments in the process of learning and teaching. 

An instructional-learning system described by Bishop (1971) an- 
alyzes instruction from a more operational standpoint. Within this par- 
ticular system there are included four basic modes of instruction for all 
students: large group discussion, small group discussion, individual or 
independent study, and laboratory instruction. It is further indicated in 
his model that some learning experiences will be common to all students 
while others will be unique or individualized for specific students. Addi- 
tionally, some experiences and learnings will be provided in more depth 
in certain curricular areas for certain students, and instructional experi- 
ences will require variability throughout the school day, week, or year. 
The author contends that the learning experience is founded upon a con- 
cept-oriented or concept-centered curriculum which offers achievement 
opportunity for all students, regardless of ability or academic potential, 
and that the learning experience is a plan of continuous progress for all 
students. An even more pragmatic approach has been devised by Briggs 
(1970). He provides a model for the design of instruction which consists 
of 10 steps that are linked together with appropriate feedback lines. These 
steps, the first of which is stating objectives and performance standards, 
are supported by detailed descriptions in various sections of the text. 

The unique characteristic of the “Instructional Gestalt Paradigm” pre- 
sented by Siegel and Siegel (1967) is the inclusion of specific independent 
variables. The four major classes or clusters of independent variables 
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which are included in the conceptual scheme are those related to learning 
environments, instructors, learners, and courses. In addition to specifying 
certain critical variables within each cluster, the authors emphasize the 
importance of interactions among the various independent variables. They 
state that these interactions may occur both among the variables within 
a given cluster and among the variables across the four clusters. ^ 

Given the various theoretical and practical frameworks designed to 
describe the concept of instruction, it may be useful to distinguish between 
instructional theories and instructional models. An instructional model is 
merely a convenient way of breaking down the instructional process to 
identify instructional problems, whereas an instructional theory must 
reflect some degree of empirical proof, and provide a means for predicting 
instructional outcomes (Association for Supervision and Curriculum De- 
velopment, 1968). An instructional theory permits the prediction of 
learning outcomes, given particular conditions in the educational environ- 
ment. 

Conceptions of Individualized Instruction 

What th'*n constitutes individualized instruction? DeHaan and Doll 
(1964) make several suggestions regarding this question. First, they indi- 
cate that emphasis should be placed on the student as a person, on the 
teacher as a person, and on the interaction that takes place between them. 
Additionally, they state that individualization occurs when the teacher 
recognizes and^responds to the emotional reactions of the learner as well 
as to his achievements, mistakes, and deficiencies. The teacher should go 
beyond ordmary achievement, thereby allowing the student to become more 
motivated and more confident in his own competency. DeHaan and Doll 
go on to indicate that the teacher should consider the pupil as in individual 
with unique perceptions, values, and needs; sensitivity to others needs is 
an important aspect of the individualization process. 

Edling (n.d.) contrasts individualized instruction with traditional 
instruction on the basis that the former is oriented toward the child. 
Appropriate learning experiences are assigned to each student. 

In order to determine what is appropriate for each learner some 
type of diagnostic procedure is used. Once these learning experi- 
ences are identified, instruction is mainly self-directed, self-admin- 
istered, and scheduled, within the school’s broad time constraints, 
at a time convenient to the learner. 

He proposes four types of individualized instruction within this context. 
These types are: 

1. Individually diagnosed and prescribed instruction — the school 
determines appropriate objectives for the student and also pre- 
scribes appropriate instructional strategies for the student’s 
mastering those objectives — may be compared to Gibbons 
(1970) previously mentioned self-paced unit plans. 

2. Personalized instruction — the student selects appropriate objec- 
tives, and the school prescribes instructional strategies for the 
student’s mastery of those objectives. 
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3. Self-directed instruction — the school determines appropriate ob- 
jectives for the student, and the student selects the instructional 
strategy to be utilized in his mastering those objectives. 

4. Independent study — the student selects appropriate instructional 
objectives and selects the strategy to be followed in his mastery 
of those objectives. 

Robert Mager in the introduction to a book written by Thorwald 
Esbensen (1968) states that an instructional system is individualized 
when each student’s characteristics play a major part in the selection of 
objectives, materials, procedures, and time. He further comments that it 
is individualized instruction when the decisions about objectives and how 
to achieve them are based upon the individual student. A series of ques- 
tions are posed which can be asked of any instructional system to deter- 
mine the extent to which it meets the needs of the individual student. 
Mager concludes by stating that one determines the degree of individuali- 
zation by asking which instructional decisions have been made and by 
whom they were made. Individualization of instruction in this context 
may occur through the variation of objectives from student to student, 
of rates of progress, of instructional purposes, and of instructional organi- 
zation (Wilhelms, 1962). 

Individualizing instruction for the disadvantaged is discussed in detail 
by W'arner (1970), who states that several variables and the interrela- 
tionships between them should be explored when an individualized pro- 
gram of instruction is being developed and implemented. These variables 
include the students, their characteristics and needs; the teaching staff, 
their personalities and expertise; the administration, its leadership and 
support; the community, its involvement and support; and the physical 
resources (facilities, hardware, and software), their usefulness or obsoles- 
cense. 

A rather sophisticated approach to the identification of what consti- 
tutes individualized instruction has been developed by Gibbons (1970). 
The author first specifies that the term individualized instruction may refer 
to a great variety of instructional programs and, therefore, may have little 
meaning as such. He then develops a classification and a profiling system 
so that differentiation may be made among certain of the individualized 
instruction programs. The profiles of several programs were compared and 
found to be quite different in the degree and kind of individualization they 
included. Gibbons identified several factors which appear to complicate 
the concept of individualized instruction, which are: 

1. The term individualized instruction is used to describe both 
minute changes in conventional teaching and changes involving 
the complete reconstruction of schooling. 

2. The term is inherently ambiguous in suggesting separate educa- 
tion for each student or any degree of modification of mass 
instruction. 
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3. Each program is individualized by the perception and the response 
of the individual; or, no program can do more than shape the 
conditions of learning. 

4. Describing the nature of individualization from different points 
of view leads to different conclusions. 

5. Individualized programs vary in the elements of instruction they 
individualize and the degree of individualization in these elements. 

6 The theoretical or philosophical reasons offered for change are 
seldom fully realized in the proposal that results; rather they are 
explained or justified as improvements to traditional practice. 

7. The individualized instruction program may be offered to only a 
portion of the school body for a portion of school time. 

Toward an Integrated View of Individualized Instruction 

There is a great deal of confusion about the definition of individual- 
ized instruction. Consequently, the authors of this report felt it necessary 
to provide a description of individualized instruction within the framework 
of this document so that a review and synthesis would be more meaningful 
to the reader. Based upon the previously described models and paradigms, 
there appear to be at least five basic components within the total frame- 
work of individualized instruction. These components could consist of the 
student, the teacher, the environment, the instructional content, and 
mediation. 

Of these five components, the student seems to be central, with the 
others being arranged in some manner which is designed to maximize 
learning. Different arrangements rnight (and probably would) be more 
appropriate for reaching different instructional objectives or for two stu- 
dents to reach the same objective. For example, teacher behavior (the 
teacher component) might be most critical in terms of aiding one student 
to attain a particular criterion, whereas, another student might be aided 
to a greater extent by the physical setting (the environment component). 

A second point relative to an integrated view of individualized instruc- 
tion is in order. It seems that these components cannot be examined indi- 
vidually as effectively as they may be investigated in relation with other 
components. For example, if we were to study the effects of varying 
instructional mediation on student learning, the inclusion of variables from 
the student component (i.e. motivation toward learning, ability, prior 
achievement) might reveal more information about how students having 
certain personal characteristics interact with certain variations in instruc- 
tional content. 

The sections which follow attempt to group research into somewhat 
the same framework that has been discussed. Given that a great deal of 
overlap existr among the various components of individualized instruction, 
studies have been grouped in accordance with impact they appear to have 
on specific components. In some cases, where a study has a great deal of 
overlap among components it is discussed with regard to each component. 
The teacher component is represented by those sections dealing with the 
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design of individualized instruction and instructional strategies. Research 
dealing with mediation is presented in the section titled educational tech- 
nology. The student is examined in that section labeled student charac- 
teristics. Although it was initially felt that the instructional environment 
component would constitute a separate section, the paucity of research in 
this area precluded development of such a section. Likewise, a section 
dealing with instructional content was deemed inappropriate. 

It was felt that content is critical to the extent that other components 
of individualized instruction arc examined in conjunction with it. Therefore, 
studies related to this general area can be found throughout this document. 
In order to account for research which takes a more integrated approach 
to individualized instruction, a section dealing with instructional systems 
is included. This section brings together those efforts which attempt to 
account for various components of individualized instruction in a sys- 
tematic manner. 



ISSUES IN THE DESIGN OF INDIVIDUALIZED INSTRUCTION 

Instructional Objectives 

Popham (1969), in tracing the evolution of the current swelling of 
interest and activity in the area of formulating instructional objectives, 
points to several factors influencing this trend. He cites the possible impact 
of such forces as: 1) the programmed instruction movement, 2) increased 
federal spending on education, 3) the delayed impact of the Taxmomy 
volume of Bloom (1956), 4) the eventual influence of Ralph W. Tyler s 
writings as well as those of his students, 5) the appearance of such instruc- 
tional aids as Mager’s volume on how to write objectives (1962), and 6) 
more oblique factors. Other influences which may have had an effect on 
the emerging popularity of instructional objectives arc the more contem- 
porary writings of Briggs (1970), Glaser (1968), Smith (1966), and 

Stolurow (1965). r u j > 

Popham’s position is that the only sensible reason for the educator s 

engaging in instruction is to modify the learner’s behavior; therefore, these 
intended changes must be described in terms of measurable learner behav- 
iors. In these terms, an instructional objective must have reference to either 
an observable behavior of the learner or a product resulting from the 
learner’s behavior. Those writers cited previously, who have in some way 
influenced the current interest in the formulation of “behavioral objectives, ’ 
would generally agree with this conception, alihough each might choose to 
extend Popham’s notion slightly. For instance, Magcr (1962) would urge 
that the conditions under which the behavior occurs and the desired min- 
imal level of learner proficiency be described in addition to the specifica- 
tion of learner behavior. , , 

The necessity for bchaviorally specifying instruc.ional goals is in- 
trinsic in the design of each of the many educational system approaches 
one secs in evidence today. In a later section, the authors examine the 
nature of “instructional systems” and describe several major efforts utiliz- 
ing this approach. Suffice it to say that systems designers generally support 
Popham’s view of objectives in the instructional process. Military and 
industrial training specialists also generally support this view (Koosis, 
1970; Straubel, 1971; and Warren, 1971). 

With such an extent of agreement among so large and influential a 
group, why arc teachers today not eagerly specifying behavior objectives 
for use in the courses they are teaching? One criticism raised in opposition 
to the behavioralizing of instructional objectives is that the easiest learner 
behaviors to specify and measure are the most trivial and will be over- 
emphasized as compared with the truly important outcomes of education 
(Popham, 1969). 

Eisner (1969) proposes an alternative conception which may serve 
to overcome that particular objection. He differentiates between two types 
of educational objectives: instructional objectives and expressive objec- 
tives. The former takes on a meaning substantially similar to the behavior- 
ally specified objectives of Popham. The latter “describes an educational 



encounter: it identifie- a situation in which children are to work, a problem 
with which they are to cope, a task in which they are to engage.” The 
intent of the expressive objective is to serve as a vehicle through which 
the skills and understandings acquired earlier can be expanded, elaborated, 
and personalized for the individual. They are meant to represent the 
higher level intellectual modes towards which instruction should be pri- 
marily directed. 

A contrasting approach to the triviality problem posed previously is 
introduced by Cohen (1967). Like Eisner, he accepts the notion of 
clearly specihed performance objectives. However, he superimposes, a 
generalized set of goals at the course level toward which the behavior 
objectives are directed. The obvious intent is to unify a set of specific 
behaviors into a more generalizable notion, in a hierarchial manner. A 
further refinement of Cohen’s notion is found in a recent article describing 
a process of occupational curriculum development (Pautler, 1970). In 
this scheme, Cohen’s bi-level structure at the course level is extended to 
a four-level hierarchy where departmental goals and overall educational 
goals represent the upper two levels. Canfield (1968) also supports the 
hierarchical notion but recommends the addition of a rationale or justifica- 
tion for each course goal. 

A second criticism of specifying behavioral objectives is that they are 
far more difficult to generate than those objectives which most teachers 
use now (Popham, 1969). As is pointed out by one able critic: 

If one tried to state all of the objectives explicitly in advance, 
he would easily spend all of his time writing objectives and have 
none left for actually teaching. This may explain why few teach- 
ers are actually as foolishly dependent on stated objectives as 
educational theorists have urged them to be (Ebel, 1967). 

An interesting article raising this same issue, and exploring its implications 
for industrial education has been written by Janeczko (1970). 

One approach in dealing with this issue is to eliminate the formula- 
tion of objectives as part of the instructional process. It has been proposed 
that a better way to start would be to design an evaluation instrument 
which would serve as the statement of outcomes to be met (Evans, 1968). 
In this case, the ever present question regarding the validity of the be- 
haviors specified would certainly be eliminated. It may be, however, that 
a confounding of measurement validity would result. 

Another aspect to this second issue as raised by Popham is a very 
practical one. In adhering to vague statements of objectives, it is possible 
even for large groups of instructors responsible for teaching selected 
courses to reach agreement. When specified behaviors are attempted, how- 
ever, such agreement may not be attained easily. Koontz (1970c), in a 
large scale systems development project at the Naval Academy, recom- 
mends that a content map be prepared prior to writing objectives. This 
map consists of blocks containing an abstract of key words referring to the 
intended objective, arranged so as to show the presumed learning hierarchy 
for the objectives. 
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As applied to vocational and technical education, an additional issue 
regarding the formulation of performance objectives has been raised. It 
is proposed that both the educational validity (the extent to which the 
objective fits meaningfully into the school environment) and the occupa- 
tional validity (the extent to which the objective specifics a competency 
essential to the particular occupation for which a student is being pre- 
pared) of an objective be examined, and an acceptable standard be met 
in both spheres (Finch and Impcllittcri, 1970). The complexity of the 
objectives formulation task increases substantially as a result. 

Baldwin (1971) discusses behavioral objectives and their applica- 
bility to industrial education. He presents a table of general specifications 
for objectives in industrial education, including specific mention of selected 
cognitive, perceptual, psychomotor and affective objectives. Two additional 
tables of specifications for objectives, the first of a course in chassis, 
suspension, and braking systems and the second for a course in the applica- 
tion of vacuum tubes and transistors, arc included in his discussion. 

In describing a three-component system designed to evaluate occupa- 
tional education programs, Conroy and Cohen (1970) emphas^^ze be- 
havior objective development as an essential feature. They state, “Devel- 
opmental activities with behavioral objectives are essential and constitute 
an important aspect of the project.” 

Taking the aforementioned notions of instructional objectives into 
consideration, it appears that several conclusions may be drawn. First, we 
are moving at a relatively rapid pace toward the systematizing of instruc- 
tion with its accompanying reliance upon the behavioralizing of objectives. 
Second, in moving from where education was in the early 1950’s regard- 
ing the systematizing of instruction toward where it may be in the 1990’s, 
several compromise steps have been, and will need to be taken. The 
necessity of these compromise notions stems from the practical impossi- 
bility of developing teachers who can adapt to the substantial modification 
in the teacher’s role at the two poles — information-giving versus directing, 
guiding and stimulating learning. In this changing condition, the focus of 
instruction which rested primarily upon the teacher in the past is shifting 
to the learner. Third, the place of instructional objectives at present is in 
the middle of that shift, necessitating in most educational situations the 
adoption of conceptions such as those proposed by Eisner (1969) and 
Cohen (1967). Practically speaking, what those particular notions allow 
is for the introduction of behavioral objectives into the instructional set- 
ting without abandoning entirely the more comfortable notions with 
which educators have been dealing for years. The authors emphasize that 
in adopting such intermediary notions, the ultimate intent is to work 
toward the complete systematization of the instructional process. 

Measurement of Instructional Objectives 

Given a set of instructional objectives for a vocational or technical 
course of study, whether behaviorally framed or not, an immediate con- 
sideration is the method of measurement to be utilized in assessing the 



degree to which these objectives have been achieved (Briggs, 1970; Koontz, 
1970c; and Mager, 1967). The purpose of this measurement is to monitor 
student progress, not to evaluate the overall effectiveness of the instruc- 
tion. Although certain inferences may be drawn regarding the latter from 
the results of the former, evaluation of instruction is of a broader concern 
and is discussed in a separate section of this review. The monitoring func- 
tion is based upon information describing individual students’ progress. 
Instructional evaluation, on the other hand, involves a judgment regarding 
the success of a given instructional segment in providing certain desired 
outcomes for a selected group of students. 

As has been pointed out previously (Finch and Impellittcri, 1970), 
instructional objectives in vocational and technical education must have 
occupational referents in addition to educational ones. The essential feature 
of instruction in this area typically provides for objectives in the form 
of performance or level of competency statements. These performances 
may be of two general types: task end-product work performances, or task 
procedure work performances. Recalling Popham’s (1969) description of 
behavioral objectives in terms of either an observable behavior or a prod- 
uct of that behavior, a considerable degree of congruence between these 
notions is apparent. Extending the notion of these twofold work perform- 
ance objectives to their measurement, one finds an interesting contrast. 
Although the techniques for measuring procedural performance differ 
markedly from techniques for measuring product performance, both are 
dependent upon the comparison of an individual’s actual performance 
with some criterion performance. What constitutes mastery of a procedural 
objective is determined in the same manner as the mastery of a product 
objective — that it meets or exceeds some minimal performance standard. 

In the vocational shop or laboratory setting the emphasis of 
measurement is upon whether a particular student has or has not 
achieved a specific objective or set of objectives. Is the student 
able to perform a specified task within accepted performance 
standards, or not? (Finch and Impellitteri, 1970) 

The measurement task in this setting is what is referred to as criterion- 
referenced measurement (Glaser and Cox, 1968; Jackson, 1970; Millman, 
1970; and Popham and Husek, 1969). The distinction between criterion- 
referenced measures and norm-referenced measures was initially intro- 
duced by Glaser (1963). Norm-referenced measures are those which are 
used to ascertain an individual’s performance in relationship to the per- 
formance of other individuals on the same measurement device, while 
criterion-referenced measures are those which are used to acertain an indi- 
vidual’s status with respect to some performance standard (Popham and 
Husek, 1969). The term “criterion” may mislead one to equate it with 
end-of-course behavior, a type of overall performance. This is not the 
case since criterion levels can be established at any point in instruction 
where it is necessary to obtain information as to the adequacy of an 
individual’s performance (Glaser and Cox, 1968). 
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Since one cannot distinguish between norm-referenced and criterion- 
referenced tests by looking at them (Popham and Husek, 1969), what 
essential difference is there between them? The principal distinction may 
be drawn in terms of their diverse intents. Whereas criterion-referenced 
tests are constructed to maximize discriminations made between groups 
treated differently and to minimize differences between the individuals in 
any one group, norm-referenced tests are constructed to maximize the dis- 
criminations made among people having specified backgrounds and experi- 
ence (Glaser, 1963). 

The implications for instruction of this distinction are quite revealing. 
The outcome in utilizing a norm-referenced test to assess instructional 
effect is to identify which of a given number of students “succeed” given 
a particular instructional process. Criterion-referenced tests, on the other 
hand, reveal which of a given number of instructional processes “succeed” 
with a particular kind of student (Moxley, n.d.). Considering the differ- 
ential effect upon students in the two situations: 1 ) in the normative situ- 
ation some students must be successful and others failures; 2) in the 
criterion-referenced condition students are eventually successful, some 
utilizing one instructional process, others utilizing another process; 3) in 
the normative frame student-ranking information may be obtained for the 
purposes of selection, but not in the criterion-referenced situation. 

Given these differing effects upon students, it is the opinion of many 
persons that the criterion-referenced measurement approach holds a de- 
cided advantage for use in vocational and technical education. Reviewing 
the intent of this approach, individualized instruction is founded on the 
maximum discrimination between groups administered different treat- 
ments (Glaser and Cox, 1968). The groups of individuals who are dif- 
ferentiated usually are conceived to be those who have mastered certain 
skills on the one hand and those who have not on the other. According to 
Millman (1970), norm-referenced procedures for assessing student prog- 
ress are inappropriate regardless of how instruction is individualized. A 
report of one aspect of a continuing effort in the area of individually pre- 
scribed instruction (IPI) clearly exemplifies the relationship between cri- 
terion-referencing and the individualization of instruction: 

Criterion-referenced tests are constructed so that ... the teacher 
can readily determine each child’s degree of competency within 
each curriculum area by testing for the presence of specific be- 
haviors. Testing the terminal objective within each grouping may 
then serve as a placement test. If the child can demonstrate 
mastery of that terminal objective, and if the hierarchy of objec- 
tives is valid, he has, by inference, achieved mastery of all the 
supporting behaviors. On the other hand, if he cannot demon- 
strate mastery of the terminal objective, the educational task be- 
comes one of determining the level at which teaching should be- 
gin. ... As the child learns and moves through the sequence, 
post-tests are used to monitor his mastery of the defined behav- 
ioral objectives. This organization offers the teacher a precise 
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method for tracking each pupil as well as allowing for specific 
instructional strategics for each objective (Rosner, 1969). 

Evaluation of Individualized Instruction 

In the previous section of this review, the usefulness of criterion- 
referenced measurement for assessing the effectiveness of individualized 
instruction strategies was mentioned. The basic question is “In what ways 
can the outcomes of criterion-referenced measures be utilized in evaluating 
the effectiveness of individualized instruction in terms of the learner?” 
Bloom and others (1971), in their Handbook on Formative and 
Summative Evaluation of Student Learning, provide much useful informa- 
tion in answering this question. They distinguish three types of evalua- 
tion: diagnostic, formative, and summative. Each of these types of evalua- 
tion, in their terms, is based upon outcomes from the administration of 
criterion-referenced measures. The diagnostic evaluation is based on the 
outcomes of administering a measure to students just prior to the instruc- 
tional process. Formative evaluation is based on the outcomes of admin- 
istering such measures at varying points throughout the instructional 
process. Summative evaluation is based upon the administration of these 
measures at the conclusion of instruction. The major distinction between 
the types of evaluation as mentioned herein is upon their differential 
purposes. 

The purpose of diagnostic evaluation is to determine a student’s 
readiness for a specified set of learning tasks, and to determine an appro- 
priate point for a student’s entry into that particular set of learning tasks. 
Formative evaluation, on the other hand, is conceived to be a monitoring 
device to determine how far the student has progressed in mastering 
certain learning tasks, to assess the nature of the remaining tasks within 
the predetermined set, and to prescribe alternative instructional approaches 
to help the student in mastering those tasks. Summative evaluation is used 
to determine the degree to which a student has mastered the complete 
set of objectives upon which the instructional unit was based, for the pur- 
pose of either grading the student or determining the degree of effective- 
ness of the instruction. 

In viewing education from the “systems” concept, there can be one 
diagnostic evaluation, one summative evaluation, and several formative 
evaluations during the course of any one student’s progress through his 
educational experience. Viewed in this way, schools have a set of hier- 
archical objectives toward which students are directed. The ultimate objec- 
tives form the basis for the summative evaluation and the set of objec- 
tives at each lower level form the basis for each of the formative evalua- 
tions. In reality, however, this view usually is not taken. The more realistic 
view of breaking down a total school experience into courses, years, or 
semesters is more feasible. In this condition, summative evaluations of 
courses, a total year of experience, or a semester’s set of experiences be- 
come diagnostic evaluations in terms of the ultimate objectives. 

Another confusing issue in evaluation of instruction is the use of the 
same information, that derived from a criterion-referenced measure, for 
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two different purposes: monitoring of the student’s progress, and inferring 
the degree to which a specified set of instructions is effective for a par- 
ticular student. 

Good instructional planning is based upon an assessment of the 
skills possessed by the intended student population, and the 
evaluation of instruction obviously must be based upon measure- 
ment of its outcomes. The mere information that learners have 
or have not acquired given behaviors serves no useful educa- 
tional purpose in itself. However, this information can be used 
to make sound decisions about instructional treatment (Sulli- 
van, 1969). 

Sullivan’s focus is upon the assessment of the effectiveness of instruc- 
tional treatments or strategies. An equally important use for measurenient 
information is the monitoring of a student’s progress through a given 
instructional unit. Both of these views, in the authors’ opinion, are of 
equal importance in assessing the quality of a sequence of instruction. In 
this regard. Bloom (1968) has specified two contrasting methods of assess- 
ing the quality of instruction. The first is an assessment of quality in terms 
of good and poor teachers, teaching, instructional materials, and cur- 
riculum — all in terms of group results. The other method of assessing 
instructional quality is expressed in terms of the degree to which the 
presentation, explanation, and ordering of elements of the task to be 
learned approach the optimum for a given learner. 

The current tendency in instructional evaluation appears to be deter- 
mination of the most effective instructional strategy in order to achieve a 
given set of objectives for an individual student. This is the central notion 
of research on individualized instruction. 

Designs for Evaluating Individualized Instruction . In one sense, all 
research exploring any aspect of the broad scope of individualized instruc- 
tion could be considered evaluative in nature. In order to determine the 
most effective instructional strategy, media utilization, or sequencing of 
objectives, for a particular student, one must evaluate. 

Typical examples of the design of instructional evaluations have 
proven to be of little help. The thousands of comparative studies designed 
to explore the differences in effectiveness between instructional method A 
and instructional method B for a particular group of students given a 
common set of instructional objectives is a good example. A researcher 
merely comparing one instructional method with another may be unable 
to demonstrate any differences in learner’s achievements until he takes 
into consideration certain student characteristics” (Bloom, et al, 1971). 
Travers (1962), in evaluating a number of studies exploring the out- 
comes of comparing one instructional methodology with another, con- 
cluded: “They have contributed almost nothing to our knowledge of the 
factors that influence the learning process in the classroom. Many of them 
do not even identify what the experimentally controlled variables are.” 
The common objection here is that in attempting to determine what in- 
structional methodology is the most effective for all youngsters in any 
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particular class, school, or grade, one is asking the wrong questions. More 
appropriate questions in a research frame are those which relate to the 
degree of effectiveness of selected instructional strategics with selected 
kinds of students. What instructional strategies are most effective for a 
group of youngsters with given characteristics, as compared with those 
youngsters with another set of characteristics? 

A relatively simple specific design of this type has been proposed 
by Bloom and others (1971), which they characterize as “an ideal, hypo- 
thetical pattern of interaction between pupil characteristics and type of 
instructional treatment.” Figure 1 represents the core of their recom- 
mendation. It conveys a two-by-two factorial design with two instructional 



Figure 1 

A design recommended by Bloom, Hastings, and Madaus (1971) 
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treatments and two groups of students, one characterized by low spatial 
aptitude and the other characterized by high spatial aptitude, the criterion 
remaining fixed. In exploring the formative evaluation of industrial educa- 
tion, Baldwin (1971) introduces an evaluative design that could be utilized 
m extending the Bloom design. Baldwin utilizes types of objectives as a 
factor (a four-l^evel factor as given: knowledge, understanding, applica- 
tion of knowledge, and application of understanding). Although spatial 
aptitude IS utilized as an example of a student characteristic which could 
be used in an evaluative design, this notion certainly could be extended 
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to include many other kinds of variables. These variables could include 
various dimensions of aptitude, interest, attitude, personality, and other 
personal variables; and a variety of background factors such as socioeco- 
nomic status, family background, and educational experience (Lindvall 
and Cox, 1969). As has been pointed out, a major handicap in trying to 
incorporate this variety of student characteristic information in an evalua- 
tion of individualized instruction is the lack of theoretical knowledge con- 
cerning the relationship between these variables and the instructional treat- 
ment (Lindvall and Cox, 1969). . • j • 

There are at least three factors which must be considered in design- 

inE an instructional evaluation. These factors are. 



1. Type or level of instructional objectives: types such as affective, 
cognitive, or psychomotor; levels within cognitive, such as knowl- 
edge, comprehension, application, analysis, synthesis, or evalua- 
tion. 

2. Student characteristics: aptitudes, prior achievement, interests, 

attitudes, other personal variables; along with socioeconomie 
status, type of family background, prior educational experience, 
and prior occupational experience. 

3. Instructional strategies: types of mediation, sequencing, pacing, 
and packaging of materials. 



Of the thousands of evaluative designs that could be conceptualized 
on the basis of these three factors, ranging from extremely simple to the 
very complex, there are relatively few different evaluative designs in the 
literature. The range of evaluative designs is extremely small, particularly 
in vocational and technical education. 

The most common design found in the voeational and technical litera- 
ture compares a particular strategy such as programmed instruction (a 
complex variable in itself) with what is typically called “traditional in- 
struction.” Students with a wide range of abilities, interests, and achieve- 
ment arc sometimes randomly assigned to the two instructional treatments. 
The instruction is directed toward those objectives which usually are 
appropriate for the programmed instruction sequence, but not for the 
“traditional instruction” whatever that treatment happens to be. The find- 
ings of this particular type of evaluative study are usually invalid. Not 
only do they ask the wrong questions, as has been inferred previously, but 
they also suffer from the following shortcomings: 1) the ‘traditional 
instruction” is usually not described and is left to the imagination of the 
reader (Stickell, 1963; and Travers, 1962); 2) the criterion test which 
measures the degree to which students meet specified instructional objec- 
tives is usually appropriate only for the assessment of the programmed 
instruction and not for the traditional instruction (Eisner, 1969; and 
Sullivan, 1969); and 3) there is no attempt to explore the interactive 
effects (Bloom, et ai, 1971; Briggs, 1970; and Travers, 1962). 

The only acceptable evaluative designs are those which in some way 
take into account the three factors mentioned previor.sly. This can be 



» a .. 



19 



accomplished in many ways varying from very simple to more complex 
designs. The one restriction limiting the number of possible designs is 
that the evaluator is not allowed to identify one group of students who arc 
to represent the general student population. He must cither look at one 
particular segment of that population, characterized by a certain level 'of 
aptitude or achievement or a particular kind of interest; or he must identify 
subgroups in the general student population such as those with a particular 
kind of interest or a particular level of aptitude. Several possibilities are 
listed below: 

1 . Given a particular instructional strategy (I|) and also given a 
particular type of objective to be achieved (Oi), how effective 
is I, in achieving Oi for two groups of students (Si and S2), 
Si being characterized by high verbal aptitude and S2 character- 
ized by having low verbal aptitude? 

2 . Given a group of students who arc characterized by a low need 
for achievement (Si), and given a specific set of instructional 
objectives to be achieved such as the application of selected 
physics principles (Oi), what is the differential effectiveness of 
two instructional strategies both designed to achieve those objec- 
tives (Ii and I2) for Si? 

3 . Given a selected instructional strategy designed to achieve knowl- 
edge-type objectives and comprehension-type objectives (T), and 
given a group of students characterized by a low numerical apti- 
tude (Si), how effective is Ii in Si’s mastery of the knowledge- 
type objectives (Oi) as compared with the comprehension-type 
of objectives (O2)? 

4 . Given two instructional strategics (Ii and I2) designed to achieve 
a whole range of instructional objectives (Oi, O2, and 0 : 0 , and 
given two types of students (Si and S2), the first characterized 
by a history of high achievement level and the second character- 
ized by a history of low achievement level: 

a. Are Ii and I2 equally effective in achieving the whole range 
of objectives for Si and S2? 

b. Do Si and S2 equally master the whole range of objectives 
for both Ii and I2? 

c. Are Oi and O2 equally mastered by the two groups of stu- 
dents given the two instructional strategies? 

d. Is one instructional strategy (I, or I2) more effective than 
the other in achieving the whole range of objectives for Si 
rather than S2? 

e. Is one instructional strategy (I, or I2) more effective than 
the other for the two groups of students in achieving Oi type 
objectives rather than O2 type objectives? 

f. Is one type of student (Si or S2) more likely to master Oi 
type objectives than O2 objectives for both instructional 
strategies? 



As these possible designs have been listed from one through four, it 
is obvious that increasing amounts of information can be obtained as the 
design becomes more complex. Where it is possible to manipulate each of 
the three factors, an increasingly larger amount of information about the 
effectiveness of strategies for particular kinds of students and objectives 
is possible. Jacobs, e/ a/. (1966) describe more specific designs of this type. 

Examples of Individualized Instruction Evaluations . The authors re- 
viewed several major efforts of individualized instruction, including evalu- 
ation, which it might be helpful to describe. These efforts range from very 
scientific and controlled experimentation to extremely haphazard and 
uncontrolled evaluative attempts. 

Esbensen (1968) in reporting experiences at Duluth, Minnesota in 
individualizing instruction, refers to some typical evaluative information; 
It is difficult to state with assurance that individualized instruc- 
tion is indisputably superior to traditional forms of schooling. 

As measured by a traditional kind of standardized achievement 
test ... the results show a general standoff in performance. 
Moreover, we have been unable to find suitable tests in such 
important areas as creativity, improvements in study habits, 
growth and acceptance of responsibility, and the like. 

In pointing to some specific effects of individualized instruction he 
provides us with the following kinds of information; 

When a school principal reports a drop in absenteeism among 
project students, this may tell us something about student atti- 
tudes toward school. When a district survey revealed that while 
school window breakage in the district as a whole increased, 
window breakage for project schools in the inner-city core sub- 
stantially decreased, this fact may tell us something about stu- 
dent attitudes toward school. . . . After several weeks in an 
individualized instruction program a young mentally retarded 
child who had a bed-wetting problem was cured. A sixth grade 
boy, an extremely shy and withdrawn student when he first en- 
rolled in the individualized program, is now chairman of a class 
oceanography project and consultant to an aerospace project 
that plans to launch four multistage rockets during the current 

school year. . . , . j 

Edling (n.d.) describes the types of evaluative information utilized 

in the 46 individualized instruction efforts he reviewed (including the 
Duluth project) . They include; standardized tests of various types; teacher- 
made tests; tests accompanying instructional packages obtained from 
Project PLAN, the IPI (Individually Prescribed Instruction) project, or 
other multi-faceted efforts; and student self-evaluations. 

Regarding the use of standardized tests, to evaluate individualized 
programs, as demonstrated in the previous two efforts, a significant posi- 
tion is offered; 

The difficulties associated with the use of standardized tests for 
evaluating educational programs are well known. Faced with re- 
sults of no significant difference when comparing his program 
with the traditional ones, the developer of a new curriculum 
indignantly, and often justifiably, denounces the validity for his 
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curriculum of the very test he selected for evaluation purposes. 

The standardiiicd, he claims, was constructed to measure the 
content of textbooks and curriculum guides in use prior to the 
development of his new curriculum. In actual fact, standardized 
tests arc not constructed to sample very specifically the content of 
any single instructional program, although quite frequently they 
sample less adequately the specific content and behaviors fea- 
tured in new curricula. . . . Because objectives vary to some 
extent from program to program, it will be difficult to ever de- 
velop a method for comparing programs that will be completely 
satisfactory to the sophisticated researcher or even minimally 
acceptable to the curriculum developer whose program fails to 
show superior results (Sullivan, 1969). 

Lindvall and Cox (1969), in describing their continual evaluation of 
the individually prescribed instruction (IPI) project at the University of 
Pittsburgh Learning Center, describe in detail the IPI evaluation system. 
They conclude that “an individualized system can achieve its true potential 
only if all of its elements are evaluated on a continuing basis and if 
information acquired is used as feedback for improvement.” They describe 
the use of placement tests, unit tests, curriculum-imbedded tests, unit 
post-tests and prescriptions in each of the IPI systems; yet they recom- 
mend that the basic function they describe could fit into a general model 
as found in other individualized programs. 

Lindvall and Cox also briefly describe Project PLAN, a project of 
the American Institutes for Research for individualizing instruction. They 
indicate that the planned evaluation procedure uses extensive pupil data 
in determining what the pupil should study and in monitoring each indi- 
vidual’s progress through the curriculum. They contend that the evalua- 
tion system built into Project PLAN should become increasingly more 
adaptive to individual pupil needs as our knowledge regarding the rela- 
tionship between individual differences and learning is acquired. 
Summary 

Sullivan (1969) in carving out the future of evaluation in individual- 
ized instruction makes the following comment: 

Remarkably few major projects in the development of new cur- 
ricula or in the improvement of classroom instruction have 
attempted to employ systematic assessment of learner perform- 
ance on precise instructional objectives as a means for instruc- 
tional improvement. Consequently, objectives-based techniques 
for conducting formative evaluation efforts with new curricula 
and for individualizing classroom instruction are in the early 
formative evaluation stages themselves. Their refinement is con- 
tingent upon evaluation of their use in the development of in- 
structional programs and in ongoing classroom instruction. Once 
such procedures have been sufficiently refined, there will still be 
a need for summative evaluation to compare programs that 
incorporate them with those that do not. Like the methods and 
inaterials in any instructional program, the value of these evalua- 
tion procedures ultimately must be judged by their effects on 
student performance. 
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STUDENT CHARACTERISTICS RESEARCH 

Research which focuses on student characteristics in the individual- 
ized instruction process has the potential to contribute significantly to 
the improvement of instructional design. This is particularly true in view 
of the increased concern about developing vocational services and pro- 
grams to meet the needs of disadvantaged and handicapped persons 
(Office of Education, 1970). There are, of course, several important 
considerations which cannot be overlooked when this area is being inves- 
tigated. Within the context of individualized instruction, student charac- 
teristics arc but a single component of the many which constitute a viable 
individualized instruction model. Cronbach (1967) suggests a learning 
theory whose propositions would state the conditions of instruction best 
for pupils of certain types with conditions and types described in broad 
dimensions. He further specifies that an important aspect of this theory 
would be the concern about aptitude-treatment interactions. DiVesta 
(1971) indicates that learning research is shifting toward the study of 
individual differences as they interact with various treatments, that is, 
“Which treatments (educational or instructional strategies) have greatest 
payoff for subjects with which characteristics?” Based upon a concern 
about the conflicting results from learner characteristics-instructional 
methods studies, Tallmadge and Shearer (1968) specify a conceptual 
model which may be useful in guiding further research. In this model, 
consideration is given to type of learning, type of instruction, and type 
of subject matter. 

It appears that research dealing with student characteristics should 
perhaps involve more than one dimension. By examining a greater number 
of variables as they interact with each other in the instructional process, 
more meaningful information can be gained regarding the effect of student 
characteristics. 

Tyler (1965) identifies a number of the dimensions which may vary 
from individual to individual. Measurable differences exist in physical size 
and shape, physiological functions, motor capacities, perceptual sensitivity, 
intelligence, achievement and knowledge, interest, attitudes, and person- 
ality traits. For the purposes of this review, several of these characteristics 
have been grouped together. First, an examination will be made of research 
findings related to the differential effectiveness of individualized instruction 
for students with varying abilities. Second, those studies will be reviewed 
in which instruction has been demonstrated to be effective with student 
groups of varying backgrounds. Third, those research studies which have 
investigated the affective characteristics of students as they relate to per- 
formance will be reviewed. 

Student Abilities 

The adaptation of training to individual differences was investigated 
by Taylor and Fox (1967). Training tasks of varied complexity were 
presented under laboratory conditions to newly inducted basic trainees in 
the Army, who were divided into high, middle, and low groups based upon 
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their Armed Forces qualification test scores. Learning performance was 
found to be directly related to aptitude level. For some tasks, group 
differences were found in rate of learning only, and for other tasks, the 
groups differed in learning rate and in final levels of performance. Per- 
formance was found to be related to training method for both high and 
low aptitude groups. The low aptitude trainees did poorly on all tasks, 
taking an average of two or three times as long to learn as the high 
aptitude trainees. 

Melaragno (1966) studied the adaptation of self-instructional materi- 
als to individual differences. In the first phase, an existing program was 
administered to the subjects individually or in small groups. The results 
provided an empirically determined adaptation procedure based on two 
pieces of information: subjects’ performance on the learning task, and 
subjects’ pretraining abilities as measured by five pretests. During the 
second phase these two procedures were compared with each other and 
with the control condition in which all subjects received a common instruc- 
tional sequence. Results supported the use of procedures which adapt 
instruction to individual differences. It was concluded that more research 
is needed on branching and prediction strategies. 

Aptitude level and the acquisition of skills and knowledges was 
examined by Fox and others (1969). Groups of high, middle, and low 
aptitude subjects were trained on different combinations of eight training 
tasks. Instructional methods were selected to maximize the 'opportunity to 
learn for the low aptitude recruits. Where practical, instruction was auto- 
mated to insure standardization and clarity, using audiovisual presentation 
including slides and video tape. All instruction was conducted individually 
with an instructor present to answer questions and provide immediate 
knowledge of results after each response. In general, the low aptitude 
subjects were slower to respond, required more training time to attain a 
specified criterion, needed more guidance and repetition of instruction, 
and were decidedly more variable as a group than the middle and high 
aptitude subjects. The learning performance for the middle aptitude sub- 
jects was typically between that of the high and low aptitude groups but 
more like the high aptitude groups. Follow-up data on subjects’ perform- 
ance showed the same general relationships. 

A study of the relationship between entering characteristics and time 
required to achieve unit mastery was conducted by Yeager and Kissel 
(1969). Relationships between unit pretest scores, number of skills to be 
mastered in the unit, student intelligence quotient, age, units previously 
mastered, and the amount of time required to complete one of four units 
was investigated. Results indicated that the number of days required to 
master a given unit was related to the student’s initial entering state, with 
most important factors being the student’s unit pretest score, the number 
of skills that must be mastered, and the student’s age. 

Silberman and others (1962) explored the interaction between pro- 
grammed teaching devices and individual characteristics of high school 
students. The variables examined were the achievement characteristics 
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(over, normal, and underachievers) of approximately ^ 

the conceptual forms for the program. The research did not aid significantly 
in the identification of dimensions for specifying the learning 
and student. It was concluded that attempts to keep methods within he 
programmed instruction framework impaired the elTectiveness of the 

instruction. , , u 

A study conducted by Bush and others (1965) explored the hypo- 
thesis that there is a relationship between patterns 

the amount learned under different instructional conditions Data gated 
tended to support the contention that students with relative stren^h i 
reading vocabulary are superior to students with relative strength in 
mathematics fundamentals when both are required to learn from instruc- 
tional conditions that are highly verbal. On the other hand, students 
exhibiting relative strength in mathematics fundamentals tend to learn 
more efficiently in individual laboratory situations than do students show- 
ing relative strength in reading vocabulary. No comparable patterns were 
revealed with the scores from the Wechsler Adult Intelligence Tests 

the Airman Qualification Examination. ■ u v > 

A series of studies by Sticht (1969) focused on learnin^y listening 
in relation to aptitude, reading, and rate-controlled speech. Three studies 
examined the ability of high and/or low aptitude men to discriminate and 
comprehend listening materials presented at rates comparable to those 
used in silent reading. Two additional studies were aimed at determining 
whether the observed limitations in comprehension of very rapid ratp ot 
speech for men at all aptitude levels were due primarily to signal distor- 
tions resulting from the process used to accelerate the speech or the rate 
of speech per se. It was concluded that certain materials may be pre- 
sented as effectively through listening as through reading for men of 
both average and low aptitude. Additionally, moderate degrees of speech 
compression may improve the listening efficiency of men with high average, 
average, and low aptitudes. The findings generally indicated that m some 
instances listening materials may be as useful as reading materials for 
training men of all aptitudes. Additional data suggests that the potentml 
motivational value of listening materials in inducing men to study should 
be explored. 

Pieper and Folley (1967) examined the effect of ambiguous test 
results on troubleshooting performance. Subject aptitude had the greatest 
effect on speed (isolation time) and accuracy of identifying the guilty 
component (identification errors). On the other hand, aptitude had no 
effect on the application of the troubleshooting strategy since both rnedium 
and high aptitude subjects used the same number of tests in solving the 
problems. Ambiguity of test results affected speed, accuracy, and applica- 
tion of the strategy. As the percentage of ambiguous test results increased, 
more time was required, less accuracy was attained, and a greater number 

of checks were used in solving problems. 

Wodtke (1965) investigated the interaction between student aptitude 
and scrambled versus order sequence of computer-assisted instruction. 
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Findings of this study indicated that it is the academically talented student 
that suffers most from a highly disorganized, scrambled sequence of 
instruction. This did not support the assumption that the high ability of 
gifted students compensates for ineffective instruction such as a poorly 
written textbook, or a poorly prepared instructional program. 

Research conducted by Gilman and Moreau (1969) dealt with some 
of the relationships between verbal content in computer assisted instruc- 
tion and verbal abilities of students. The subjects consisted of tile-setting 
and plumbing students at a community college. The experiment used two 
versions of a program, one with high verbal content and one with low 
verbal content. Results indicated a lower correlation between intelligence 
and learning on the part of the students who studied the low verbal 
content program. The authors recommended a greater effort to program 
materials with the lowest possible verbal content so that low ability stu- 
dents can more adequately comprehend the programs. 

As part of an investigation by Armstrong (1967), selected criterion 
measures were correlated with mental ability in order to identify possible 
relationships which might have implications for programmed instruction 
and individualized instruction. It was concluded that both methods of 
instruction were equally effective for both low and high potential achievers. 
No significant correlation was found between mental ability and achieve- 
ment or between mental ability and retention for either method. 

The effect of special practice frames upon programmed instruction 
performance was examined by Melching and Nelson (1966). Students in 
this study represented two levels of verbal ability. Practice frames enabled 
the subjects to proceed through the program at a faster rate per frame, 
make fewer program errors, and score higher on a recall type achievement 
test. Subjects of higher verbal ability were able to proceed through the 
program at an even faster rate, make fewer program errors, and exhibit 
higher scores on all achievements measures. Melching (1965) examined 
the relationship between measures of ability and programmed instruction 
performance. Data from several programmed instruction studies served as 
the basis for the results. With few exceptions, each ability measure tended 
to be substantially related to each measure of programmed instruction 
performance. 

The effect which visual-haptic aptitude has on student-teacher inter- 
action and mechanical drawing achievement is reported by Erickson 
(1967). The data revealed that students who were instructed by a non- 
visually oriented teacher attained a mean level of achievement which was 
significantly higher than the mean level of achievement attained by their 
counterparts who were instructed by visually oriented teachers. Addi- 
tionally, the students identified as visually oriented were, as a group, the 
highest achievers, while those identified as haptically oriented were the 
lowest achievers. 

Student Background Characteristics 

Studies focusing on student background characteristics are not as 
prevalent as those which examine student achievement and abilities. Haskell 
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(1969) studied the effects of personality characteristics upon learning by 
various modes of instruction. A treatment by levels (of personality) 
analysis of covariance design was used with achievement test scores serving 
as the criterion. No significant differences were found in the mean achieve- 
ment of groups who received the various treatments. Significant differences 
in achievement were found among groups of subjects whose personality 
was categorized as low, medium and high on the restraint, emotional 
stability, and masculinity scales. There were significant interactions be- 
tween instructional methods and levels of subjects categorized as low, 
medium and high on the general activity and friendliness personality 
variables. It was concluded that programmed instruction appears to hold 
promise for students who are agreeable and easy to get along with and/or 
who are inclined to be slow and methodical, while more aggressive students 
appear to perform better under conventional instruction. The general 
activity and friendliness scales of the Guiljord-Zimmerman Temperament 
Survey appears to be useful in prescribing maximally effective instructional 
methods for individual students. 

Tallmadge and Shearer (1967) conducted a study to determine 
whether training effectiveness could be increased by employing training 
systems which differed in design and use as a function of identifiable 
student characteristics. A complete factorial experimental design was em- 
ployed involving a control and two experimental training methods and 
16 measures of trainee aptitudes and interests. Large and statistically 
significant achievement differences were found to result from the three 
training methods with the “understanding” course superior to both other 
versions. Interactions between training methods and learner characteristics 
were not significant. It was concluded that the lack of interactions resulted 
from the heterogeneity of subject matter and skill content of the course 
and interaction of content with training methods. 

Three experiments reported by Briggs (1961) dealt with the sched- 
uling of training conditions for the acquisition and transfer of perception 
motor skills. Results suggested that one can provide either too much or 
too little prior training; the group receiving a “medium” amount of such 
training was superior on the non-aided tasks to groups receiving a rela- 
tively small or a relatively large amount of training. The results of two 
additional studies in the series specified that inappropriate scheduling of 
augmented feedback conditions and feedback which is not augmented at 
all accounts for negative performance. 

Fedel (1965) reported some of the variables which are related to 
individualized instruction procedures in typing and shorthand. Data indi- 
cated that students who had taken junior high typing had a higher average 
speed than students who had not. It was also noted that sex and intelli- 
gence were not related to typing speed. 

Lecture-discussion and self-directed study methods were compared 
in a study conducted by MacNeil (1967). The methods were compared 
for relative effectiveness in attaining the objectives of a course on nutri- 
tion; for possible relationships between student personality characteristics 



and achievement of course objectives with either method; and for the 
attitudes of students expressed in terms of satisfaction toward the course 
and toward the method of instruction. A significant difference favoring 
the Iccture-discussion group was found. Students with either high or low 
ratings for autonomy showed higher levels of achievement when taught by 
a Iccture-discussion than did those similarly classified in the experimental 
group. Achievement of course objectives was directly related to student 
overall scholastic ability, including reading comprehension and listening 
comprehension. Neither of the methods compared indicated any significant 
advantage to students within specific ability levels in respect to achieve- 
ment of course objectives. 

Student Affective Characteristics 

The last series of studies to be included in this section are those 
dealing with the affective characteristics of students. Variables included 
in this category consist of those which are temporary, such as the personal 
variations resulting from situational conditions (i.e. attitude toward a 
situation, anxiety, etc.). 

Miller and Rosenquist (1965) reported on the effects of programmed 
instruction on attitude and achievement. Students enrolled in an electricity 
class and an electronics class were studied for one semester to evaluate 
the effectiveness of using the Autotutor Mark II which had been pro- 
grammed to permit individual study. Additionally, initial learner attitude 
toward programmed instruction and subsequent attitude shift as a result of 
continued exposure to this instructional technique were evaluated. No 
significant differences in achievement were noted in the three groups as a 
result of the instruction. The attitude evaluation of the programmed in- 
struction poup showed a shift from a highly positive to a definitely nega- 
tive reaction. The students were most critical of programmed instruction 
in the area of quality of explanation. It was concluded that the treatment 
failed to help students build desirable attitudes toward programmed instruc- 
tion. 

Ugelow (1962) presented a literature review dealing with motiva- 
tion and the automation of training. A selective review of the literature 
on knowledge of results, praise and reproof, competition, task interrup- 
tion, and readability suggests techniques for controlling such participation. 
Potentially useful applications of motivation principles are discussed by 
the author. 

Development of an instrument to assess student attitude toward shop 
and laboratory instruction is described by Finch (1969). The Likert-type 
instrument was designed to assess attitude toward a specific period of 
instmetion such as an hour, day, week, or month. Validity and reli- 
ability data are reported in detail. Results of the development suggest 
that attitude may be related to concurrent or subsequent behavior and 
that students’ attitudes toward instruction may vary in accordance with 
the particular instructional environment. 

Wodtke, Mitzel, and Brown (1965) investigated student reactions 
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to individualized computer assisted instruction. Following an initial session 
of computer assisted instruction, each student completed a student reac- 
tion inventory which was modeled after Osgood s Semantic Differential. 
Attitude scores indicated that some students w'ere highly motivated to do 
well in the course, while others were flustered by the machinery. Addi- 
tionally, a correlation analysis was made between student program errors, 
rate of performance, ability scores, cumulative grade point average, per- 
sonality score, and score on the student reaction inventory. The correla- 
tions generally indicated that students having lower cumulative grade 
points and lower ability scores tended to rate the course and machine as 
fast. The data suggested that computer assisted instruction employing 
optional delays, optional review, and optional remedial work would be 
beneficial for some students. In a study conducted by Dwyer (1968) 
student perceptions of the instructional value of visual illustrations used 
in a programmed textbook were compared with data resulting from a 
criterion test covering the instructional content. It was concluded that 
student perceptions probably do not provide a valid indication of the 
instructional value of visual illustrations used in programmed instruction. 

Wills (1965) examined the effects of teaching shop procedures em- 
phasizing speed of performance. Results indicated that students exposed 
to speed of performance procedures did not differ appreciably in their 
attitudes toward the course from a group which received no such emphasis. 
It was noted, however, that the speed of performance group produced a 
greater quantity of work with more errors and less economy of materials. 

Neidt and Meredith (1966) studied the changes in attitudes of learn- 
ers when programmed instruction is interspersed between conventional 
instructional experiences. Five parallel forms of a Likert-type attitude scale 
were administered in counterbalanced order to 70 airmen studying radia- 
tion detection and 53 airmen studying camera repair. Both courses included 
several weeks of lecture, a program unit, and several more weeks of 
programmed instruction. Student attitudes were significantly more favor- 
able during the programmed unit in both courses. Changes were consid- 
erably more pronounced for the 17 highest ability students. 

Summary 

The studies which have been reviewed that deal with various student 
characteristics are indeed few. This is particularly evident in the areas of 
student background characteristics and affective characteristics. 

There are, however, certain trends that can be identified from the 
studies which have been reviewed. The research generally indicates that 
positive relationships exists between student characteristics and achieve- 
ment as a result of instruction. In particular, a strong relationship seems 
to exist between various measures of student ability and learning. More 
questionable relationships appear to be present with regard to student 
background characteristics (i.e. prior instruction and personality). Finally, 
the absence of student affective characteristics research precludes any firm 
conclusions in this area. Some relationships may exist between affective 
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measures and behavior, although the research surface has been barely 
scratched. 

Several final comments relative to student characteristics research 
are in order. Few of the studies cited have been programmatic in nature. 
That is, the bulk of the research reported has been concerned with but 
one Or two dimensions of the instructional process. Additionally, the 
majority of the studies reported in this section were conducted by military 
training researchers. Evidently the nonmilitary training research com- 
munity is not too concerned about student characteristics as they relate 
to the instructional process. This is unfortunate in view of the importance 
which is placed upon student characteristics as input to an individualized 
instructional system. Hopefully more relevant research in this area will be 
generated in the future. 



EDUCATIONAL TECHNOLOGY 

Programmed Instruction 

During the early and mid-1960’s, programmed instruction was her- 
alded as a revolutionary new approach to teaching which might have the 
potential to truly individualize the learning process. Since that time, how- 
ever, the panacea image has been somewhat tarnished. Persons conducting 
research on learning variables as they applied to programmed instruction 
found that some programming principles did not always stand up under 
rigorous scrutiny. Others who made extensive use of programmed instruc- 
tion in learning situations found that was not the final answer to ques- 
tions concerning the meeting of individual needs. Consequently, the studies 
which follow have been reviewed much less optimistically than they would 
have been a decade ago. 

Although this programmed instruction review is oriented toward 
vocational and technical education research, one must not overlook the 
many studies which have been conducted by educational researchers em- 
phasizing other instructional areas. One of the basic references was devel- 
oped by Stolurow (1961). He examined the principles of programming 
in terms of many of the relevant learning variables which might be con- 
sidered when a program is being developed and evaluated. Also included 
arc techniques for writing programs, examples of programming^ tech- 
niques, and a summary of some of the earlier research findings in this 
area. An annotated bibliography developed by Schramm (1964) provides 
an excellent review of research on programmed instruction conducted dur- 
ing the early 1960’s. A most meaningful addition to the files of the pro- 
grammed instruction researcher would be the scheme developed by Fry 
(1963), which classifies variables involved in a programmed instruction 
situation. The classification would be especially meaningful for a variable 
or group of variables related to programmed instruction if one wanted to 
control for the effects of other variables. A more recent document edited 
by Glaser (1965) takes infomiation on new research in programmed 
instruction and integrates it with that of the past. This compilation contains 
over one thousand references. Of particular interest is the review of pro- 
grammed instruction research which is reported by Householder (1968). 
He indicates that “research utilizing programmed instruction in vocational, 
technical, and practical arts education has evolved somewhat more slowly 
than in other educational areas.” 

A more recent report by Mayo (1969) attempts to bring together 
available information on programmed instruction in order to arrive at 
conclusions about its significance and appropriate role in technical train- 
ing. The specific focus is upon research and experience within the Naval 
Air Technical Training Command. Conclusions favor continued activity 
in programmed instruction and emphasize the importance of individually 
paced instructional systems. In addition to providing an extensive overview 
of the characteristics of programmed instruction, Norton (1967b) discusses 
some of the supporting psychological principles, research findings, advan- 
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tages, and limitations of this medium. Case studies are presented from 
schools and industries which are using programmed instruction success- 
fully in occupational education. Criteria for assessing programmed instruc- 
tional materials are also included. Henry (1968) considers approaches for 
incorporating programmed instruction into a class environment. Criteria 
for programmed material selection should include content, style, challenge, 
length and cost. Warren (1971) focuses on the characteristics of the 
programmed instruction designer as they relate to quality of the program. 
Considerable emphasis is placed upon the production of high quality 
programmed instruction materials. 

Programmed Instruction and Conventional Instruction. A number of 
researchers have chosen to examine programmed instruction as it relates 
to “traditional” instruction or some conventional approach such as lecture- 
demonstration or discussion. Gibbs and others (1968) compared conven- 
tional and programmed instruction in bookkeeping. The programmed 
instruction group scored significantly higher on all three of the post-tests 
and also experienced a 43 percent reduction of learning time. 

Programmed and lecture discussion methods of teaching farm credit 
to high school youth and adults were examined by Hull and McClay 
(1965). In the first phase of the study the lecture-discussion method of 
teaching resulting in significantly greater gains in knowledge; however, it 
was noted that some lecture-discussion teachers used twice as much time 
as did the programmed-instruction teacher. When the amount of time 
was controlled during phase two of the study, there was no significant 
difference between the mean scores for each method. 

Programmed learning in extension training was examined by Hyman 
and Marsh (1964). Findings indicated that programmed self-instruction 
was as effective as workshop instruction in increasing extension agents’ 
knowledge of the radio, developing more positive attitudes toward use of 
the radio in extension teaching, and changing the agents’ concept of their 
ability to do radio teaching. 

Aiguirre (1966) studied the programmed instruction-demonstration 
and illustrated lecture-demonstration methods of teaching engine lathe 
principles and operating procedures. The author concluded that the method 
of instruction did not have a significant effect upon achievement, engine 
lathe manipulative performance, or retention. 

The purpose of research reported by Ballard (1966) was to deter- 
mine the extent of achievement and retention of learning as a result of 
an instructional unit on wood joinery. The unit was taught by two methods 
— programmed instruction, and lecture-discussion illustrated by color 
slides. Results revealed that students taking their initial college course in 
woodworking retained cognitive information relative to wood joinery 
better when taught by the programmed instruction than by listening to 
slide lecture lessons. Additionally it was reported that achievement of 
learning was greater when teaching was provided by programmed instruc- 
tion over the subject matter content of dowel reinforcements and wood 
joints. 
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Programmed versus conventional instruction as preparation for lab- 
oratory performance was investigated by Campbell (1969). Pupils who 
studied the program scored significantly higher on the written test than 
those who studied by the conventional method. However, no significant 
difference was found between scores on the performance test. 

Curl (1961), when he explored the effectiveness of a self-instruc- 
tional method for teaching equipment operation, concluded that perceptual- 
motor skills relating to the operation of certain types of photographic 
equipment can be taught individually by means of a self-instructional, 
demonstration-practice-test type of program. He also commented that 
necessary verbal cues can probably be presented as effectively in caption 

form as with a recorded commentary. 

Manchak (1965) made an experimental comparison of two methods 
of teaching a perceptual-motor task. The findings indicated that the pro- 
grammed material produced statistically significant differences in overall 
achievement between the two lower ability groups. There were no sig- 
nificant differences with upper ability subjects. Likewise no significant 
differences in performance were found betweeii the two groups. 

Student achievement in a manipulative skill when taught by lecture- 
demonstration and modified programmed instruction was examined by 
Seal (1969). The research involved a comparison between a traditional 
and an experimental method to determine student learning of beginning 
welding. There were no significant differences in student achievement for 
any of the tensile tested welds. The experimental group, however, was 
significantly superior on the destructive bend test. 

A study conducted by Simich (1965) compared a self-instructional 
course and a correspondence course with a programmed method of in- 
struction. Findings indicated that students in the correspondence course 
group gained significantly more knowledge than students in the pro- 
grammed group. A three week delayed examination revealed that there 
was a substantial gain at the upper and lower ability levels in each of the 

treatments. . 

Hughes and McNamara (1961) compared the learning achieve- 
ment of employee classes taught by programmed textbooks with that of 
classes taught by conventional classroom instruction. Although a differ- 
ence was found between the control and experimental group achievement 
means even after adjustment for Programmer Aptitudes Test scores, this 
could have been caused by a difference in variance of the groups. It was 
also noted that the mean completion time for the programmed instruction 
classes was 8.8 hours, with large individual differences, while the control 
classes were 15 hours. 

Approximately 13,000 basic military trainees were used in a field 
experimental study of programmed instruction on manipulative tasks 
(Policy, et al, 1964), The modes of training included lecture-demonstra- 
tion, a printed linear program with or without an answer sheet, and an 
audiovisual program presented by an audiovisual device or a printed 
booklet. Also evaluated was a condition in which the trainees tried to 



perform the final task and wefe assisted as required. The content of the 
training was varied by providing training on assembly only, disassembly 
only, or both. The final criteria were the time and number of assists re- 
quired to disassemble and assemble the M-1 carbine. No modes of train- 
ing seemed superior to the other modes. The audiovisual program pre- 
sented in the printed booklet seemed somewhat inferior. Training on only 
the assembly of the carbine resulted in as good a performance as training 
on both assembly and disassembly. Findings probably can be generalized 
only to relatively simple procedural type tasks. 

Cochran (1966) reports on the evaluation of an experimental lettering 
program. Results revealed that all three methods of instruction (con- 
ventional, direct-detailed, and programmed) were equal in teaching the 
technical knowledges of lettering. However, programmed instruction was 
superior in the development of practical lettering skills. 

A comparison of self-instructional methods and demonstrations and 
teaching manipulative operations was conducted by Hofer (1963). Written 
tests covering the knowledge of terminology and procedure were given 
immediately after instruction and one week later, and indicated that stu- 
dents learned and retained slightly more information when they received 
instruction from printed programs. It was also noted that 69 percent more 
individualized assistance was required when instruction was presented 
by demonstration than when presented by programmed materials. 

Kopstein and Cave (.1962) consider the comparative costs of training 
with automated and conventional instruction. Three different methods of 
estimating the cost of a prototype automated course in electronics are 
compared with the estimated costs of a current conventional course. Costs 
of automated instruction compare favorably with those of the conventional 
course regardless of the method of estimation. Further, these costs continue 
to diminish as the number of students trained increases, whereas conven- 
tional costs remain constant. Generalizations related to the economic 
factors of auto-instruction are discussed in terms of application to Air 
Force training courses. 

The Development of Programmed Instruction Materials . Although 
this research review does not deal specifically with activities involving the 
development of programmed instruction materials per se, it was considered 
appropriate to include several representative studies which deal with the 
design of programmed instruction. The studies which follow are perhaps 
representative of efforts to change the behavior of students through the 
medium of programmed instruction as compared with students who do not 
receive such instruction, 

Coffey and others (1968) described a programmatic effort in the de- 
velopment of self-instructional methods for selected areas of vocational 
education. The authors report that evaluations of five units supported 
the relative efficiency and effectiveness of self-instruction in these areas. 
Studies of the skills of auditory diagnosis in mathematical word-problem 
solving did not result in units that could be evaluated. 

The influence of a set of programmed materials on vocational values 




4U 



34 



was examined by Grubb (1965). A programmed textbook, Value and 
Choices, which was developed for the study, is concerned with certain 
aspects of career planning and is potentially an instrument that can be 
used for vocational guidance purposes. The study was concerned with 
the influence of three factors on each of the sub-skills included 
Vocation Values Inventoiy (VVI). Major conclusions were that 12th 
grade males and females who use the programmed textbook value the 
self-realization aspect of work more than 11th and 12th graders who did 

not use the textbook. . t 

The value of programmed instruction in the enhancement ot the 

career objectives of high school cooperative distributive education stu- 
dents was examined by Trimpe and others ( 1966 ). Instruction for the 
treatment group consisted of a self-study program in retail food store 
operations, while the control group was engaged in regular classroom 
activities. Conclusions were that a majority of the students began with 
an unfavorable attitude toward retail food distribution as a career objec- 
tive and the programmed information reinforced these negative attitudes. 
Students did, however, gain some knowledge about the food iimustry. 

Programmed Instruction as C ompared with Structu red Group and 
Indi vidual Instruction Approach es. Several studies have been identified 
which compare programmed instruction with media or with instruction 
which is typically individual in nature (i.e., textbook study, shop or labora- 
tory work). Additional studies examine the place which programmed 
instruction has within the instructional process. Several examples of these 

studies follow. . . ci , • 

Lundy (1968) compared programmed booklets with sound nimstnps 

in teaching automotive electricity. The data revealed that achievement of 
learning is greater when teaching is presented by programmed instru^ion 
as opposed to instruction given by sound filmstrip. This was true of both 

initial learning and retention. . 

The purpose of a study by Bensen (1967) was to compare the relative 
efiectiveness of teacher-prepared linear program instruction sheets in the 
teaching of manipulative operations. Two experimental groups, each 
using one of two types of programmed operation sheets, were evaluated 
and compared with the control group which utilized a standard operation 
sheet. The findings revealed that the programmed materials had a positive 
effect in supplementing the group demonstration in teaching manipulative 
operations. The effect, however, was limited to two of the four variables 
studied. These variables were the amount of technical knowledge acquired 
by the student and the amount of assistance required by the learner in 

completing the job. . . « 

Finch (June, 1969) compared selected self-instructional approaches ot 
teaching diagnostic problem solving to automotive students. The equip- 
ment-oriented treatment group required the shortest instructional time 
and its troubleshooting performance was significantly better than the 
textbook-oriented and programmed instruction groups. Results also indi- 
cated that no significant difference existed in troubleshooting knowledge 
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or attitude toward instruction. It was concluded that equipment-oriented 
methods might be most effective for teaching complex performance tasks. 

The use of programmed instruction with and without self-instructional 
practice to teach psychomotor skills was studied by Norton (1967a). The 
data failed to support the theory that programmed instruction can satis- 
factorily teach psychomotor skills which primarily require the learning 
of cognitive knowledge in order to properly use motor skills the learner 
already possesses. Likewise the method used to supplement the pro- 
grammed instructional materials in the study, namely self-instructional 
practice, did not produce any significant benefit over the use of the pro- 
gram alone. 

An experimental comparison of linear program and standard text- 
book approaches in teaching basic electronics was conducted by Lease 
(1964). Students in the program treatment were provided with com- 
mercially prepared material in basic electronics, while students in the 
textbook treatment utilized a textbook especially designed to parallel the 
program. No significant difference in the effectiveness of the program and 
the textbook were found as measured by the amount of factual material 
initially learned or retained after six weeks. Additionally, no significant 
differences were found in the effectiveness of the linear program and the 
textbook as measured by the ability of students to apply electronics facts 
and principles initially learned and to spply facts and principles retained 
after six weeks. 

Stephenson (1969) compared programmed text material with a pro- 
grammed lecture in teaching lumber measurement concepts. Two experi- 
ments were conducted, with the second one replicating the first. For both 
-experiments, a significant difference in the level of achievement was found 
which favored the programmed text group over the programmed lecture 
group. It was concluded that junior high school students studying a unit 
in lumber measurement concepts by programmed instruction can achieve 
more than students studying the same unit by programmed lecture. 

-Internal Changes in Programmed Instruction . Several researchers have 
studied the effects which internal changes in programmed instruction have 
on learning. These modifications differ from variation in learning strategies 
in that they deal more with program structure than with learning theory. 

A comparison of learning and retention of information learned 
through the use of linear and branching programmed instruction is reported 
by Shull (1969). The results of the study indicated that there were sig- 
nificant differences in learning between the linear and branching groups 
as measured by the immediate post-test. The difference was in favor of the 

branching group. The difference on the two-week delayed post-test was not 
significant. 

Finn (1965) attempted to determine the effect upon learning of using 
different question arrangements with a linear program about standard 
food measuring equipment. The program was arranged into three forms 
which included: 1) 144-framc linear program, 2) the linear program pre- 
ceded by 12 motivational questions and including the same 12 questions 
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interspersed in the appropriate places for participation questions, and 3) 
the linear program preceded and followed by the same 12 questions used 
in the second form, It was found that there were no significant differences 
between the groups on a criterion test which was administered after the 
program had been completed. It was also reported that the form P‘'°* 
gram had little effect on the amount of time taken to complete it. Those 
with high IQ scores tended to take less time to complete the program 
than those with low IQ scores. Girls had a somewhat positive attitude 
toward the program, however, neither form of program nor IQ had any 
noticeable effect on attitude. Additionally, the criterion test score was 
highly correlated with IQ and with retention test score. IQ score was 
positively correlated with criterion test score and retention test score and 
negatively correlated with number of errors on the program. 

A study which tested means of improving programmed instruction 
by adding motivation materials to increase the desire to learn was con- 
ducted by Lanham and others (1963). One program consisted of two 
programmed lessons to teach technical vocabulary related to the com- 
mercial letter of credit. A second program added techniques of persuasion 
utilized in the field of advertising in the first lesson and an incentive in 
the form of stories using realistic situations in the second. A third program 
had one lesson on how to learn technical vocabulary and a second on 
applying the how-to-learn technique. Although learning did result, there 
were no significant differences between or within treatment groups as to 
the amount of learning or retention which occurred. 

An investigation was undertaken by Klaus (1964) to determine 
whether step size in linear programs could be defined, measured, and 
manipulated, and to determine the effects of various step sizes on error 
rate and achievement for learners at three levels of ability. Step size affected 
error rate and learning time measures but did not appear to affect achieve- 
ment measured either by a proficiency test composed of criterion frames 
from the program or a transfer test adapted from the test originally pre- 
pared to accompany each program. Ability level had a substantial effect 
on error rate, learning time measures, and achievement. Error rate had 
no aonarent relationship to achievement when the effects on ability level 



were removed. 

Research which examined learning set formation and programmed 
instruction was reported by Reynolds and others (1964). Two different 
orders of three units of programmed instruction were administered to 
groups of students who were matched on either intelligence or relevant 
achievement tests. It was hypothesized that after varied amounts of prior 
practice in programmed instruction, learning set formation would not be 
demonstrated by the high intelligence and the high achievement groups, 
and learning set formation would be demonstrated by the average achieve- 
ment groups. The data indicated that in a program sequence, error rate 
is a more appropriate measure than achievement for observing learning 
set formation. Learning set formation is observable in programmed instruc- 
tion for all learners regardless of individual differences. Since error rate 



differed for some of the experimental groups while achievement remained 
the same, the results were interpreted to mean that a moderately high 
error rate program which offers opportunity for correction of response 
errors may be as effective in producing learning as a iow error rate program 
which confirms correct responses. 

As part of a study reported by Bensen (1967) the effects of a tech- 
nical line drawing as an illustration in each frame of programmed instruc- 
tion sheets were examined. The study did not substantiate previous find- 
ings which indicated that illustrated programs arc superior to non-illus- 
trated programs in studies involving the learning of skills. It was felt that 
any effect that illustrations might have on understanding the concept and 
aiding in the performance of the operation arc cancelled out by instruction 
received through the demonstration. 

Summary. There arc several comments which can be made relative to 
programmed instruction research in vocational and technical education. 
By far the largest number of studies seemed to center around comparing 
programmed instruction with 'traditional” learning methods. Moreover, 
many of these studies as well as others which were not included in this 
section focus on verbal learning as measured by pencil and paper type 
examinations. Finally, research studies which examine the effectiveness of 
programmed instruction in promoting attitudinal change are obvious by 
their absence. 

With the aforementioned shortcomings in mind, it is difficult to 
develop a concrete synthesis of research. Those studies which are reported 
do, however, seem to have several relevant implications for vocational and 
technical education. It appears that programmed instruction does, in fact, 
teach and that exposure to it results in a change in behavior. This change 
IS, of course, dependent upon the programming principles used and the 
objectives to be attained. Programmed instruction is at least as good as 
conventional instruction” if that conventional approach is oriented toward 
classroom type (cognitive) objectives. The research reported generally 
indicates that there may be some point at which programmed instruction 
loses Its teaching effectiveness. That is, higher order learning principles 
(i.e complex perceptual motor activity integrated with problem solving) 
might be better taught by means other than programmed instruction. 
Further research in this particular area is certainly in order. Several of the 
studies included in this review examined multiple criteria such as time 
attitude, verbal behavior, and physical behavior. It is hoped that this 
approach to research in programmed instruction will continue. Since 
results seem to indicate that programmed instruction is successful in some 
applications but not succ..'sful in others, it may be necessary to weigh 
the advantages and limitations of a particular program within a specific 

earning situation as applied to students having certain entering charac- 
teristics. ® 

Computer-Assisted Instruction in Vocational and Technical Ediu.nion 

The use of computers as an integral part of the instructional process 
has increased quite rapidly since 1959 at which time the first efforts in 
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this area were made (Hall, 1970). The appeal of computer-assisted instruc- 
tion stems from at least three fundamental characteristics of the computer. 

1) its ability to evaluate students’ responses and provide information 
reeardine the degree of correctness of these responses, 2) its capability to 
allow active response by the student, and 3) the capability of the com- 
puter to keep a record of a student’s performance and alter the course 
sequence for that student based upon his immediate task performance 

(Hall, 1970; Schurdak, 1967). , ,u Hn 

Computer-assisted instruction (CAl) is an outgrowth of the work in 
programmed instruction by B. F. Skinner and the efforts of Sidney Pressey 
with his teaching machines (Hall, 1970). The application of computers 
to instructional tasks provides a powerful extension of the programmed 
instruction and teaching machine concepts in overcoming a number ot 
the obstacles in the individualization of instruction. Zinn (1967) lists six 
instructional applications of the computer: drill, tutorial, simulation and 
gaming, retrieval and reorganization of information, problem solving with 
computation and display tools, and artistic design and composition. 

Three CAI projects of significance in vocational and technical educa- 
tion were identified. These are: Experimentation with Computer-Assisted 
Instruction in Technical Education (Mitzel and Brandon, 1965); and 
Project IMPACT (Seidel, 1968); CAI at the Naval Academy (Koontz, 

1970a). ... . j 

The objectives of the CAI project in technical education conducted 

in the Computer-Assisted Instruction Laboratory at The Pennsylvania 

State University were: 

1) i ■ evaluate the articulation of computer-assisted instruction with 
other educational strategies and, by means of careful experimenta- 
tion, determine optimum ways of presenting core courses in tech- 
nical education curricula; 

2) to prepare curriculum materials for computer presentation with 
emphasis on the instruction of post-high school students in tech- 
nical mathematics, engineering science, and communication skills; 

3) to train an interdisciplinary group of individuals to prepare course 

materials and to do research on computer applications in tech- 
nical education; . . 

4) to disseminate the information and evidence concerning the inno- 
vation of CAI and its application to occupational education 
(Mitzel and Brandon, 1965). 

Selected units in technical mathematics, technical physics and communica- 
tion skills were developed during the four-year duration of the technical 

education project. »,r.A/-rr 

Developed for application to the military. Project IMPACT repre- 
sents one of the first attempts to provide a multi-purpose CAI system 
which is economically feasible. 

Project IMPACT is an advanced development effort designed to 
provide the Army with an effective, efficient and economical 
computer-administered instruction system. The objective is to 
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(a) develop two generations of prototype CAl systems with (b) 
accompanying prototyf>c multipath (branching) individualized 
programs of instruction (Seidel, 1968). 

Given the qualification that this instruction be made directly relevant 
to a trainee’s specific job requirements, it would seem likely that courses 
developed within Project IMPACT would be applicable to vocational and 
technical education. 

The CAI applications at the Naval Academy involve the use of both 
teletypewriter equipment and cathode ray tube equipment. Several tech- 
nical courses such as Underwater Acoustics, Heat Transfer, Electrical 
Circuits, and Mechanics of Materials have been developed for use in the 
CAl presentation. Although designed for use by students at the Naval 
Academy, it would seem that courses such as these would have some 
application to technical type courses currently being offered in our com- 
munity college programs. A recent progress report of these CAI efforts by 
Koontz (1970a) indicates quite favorable results. 

There have been several approaches to evaluating the application 
of CAl material to technical education. Farr and Hogan (1967) report 
the results of a study designed to determine the degree to which communi- 
cation skills learned in a CAl instructional unit were transferred to a 
natural writing task. The sample consisted of 48 post-high school two-year 
technical students. It was found that no significant transfer resulted from 
the CAl experience. Schurdak (1967) in teaching a unit of the program- 
ming language FORTRAN provides an evaluation of the use of CAI. He 
indicates that the computer can successfully perform a number of instruc- 
tional functions. Because of its effectiveness as applied to these instruc- 
tional functions, CAI could be used to make the teacher’s time available 
for more intimate interaction with the students. Kopstein and Seidel 
(1967) take issue with the value of Schurdak’s evaluation, and strongly 
question the criteria utilized by Schurdak in his evaluation of CAI. 
Schwartz and Haskel (1966) utilized a CAI unit to teach basic data process- 
ing principles to a group of 79 electronics technicians. The effectiveness 
of the CAI approach was compared to the effectiveness of the same 
material as presented through a programmed text. No significant differ- 
ences in scores on the criterion tests were obtained although there was a 
significant amount of time saved by those students who experienced the 
CAI approach. In addition, the attitudes of the students toward the instruc- 
tion were about equivalent in both groups. 

Research conducted in the area of CAI has been plentiful, yet the 
authors identified very little research with specific implications for voca- 
tional and technical education. There were, however, seven studies identi- 
fied, five of which were conducted by the Computer-Assisted Instruction 
Laboratory at The Pennsylvania State University. Two of these studies 
were conducted utilizing a sample of students in plumbing and tile setting 
at Williamsport Area Community College. The first of these explored the 
effects of remedial branching as oppo.scd to review branching on student 
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learning. The CAI unit utilized in this experiment was one developed as 
part of the technical physics course development. It involved working 
with measurement units. It was found that students who were branched 
to a set of remedial frames scored no differently on the criterion t«ts than 
the students who were exposed to review frames (Gilman and Gargula, 
1967). 

A second of these studies investigated the interaction between verbal 
aptitude and the degree of verbal content included in a CAI unit. Eighteen 
subjects with low verbal aptitudes were assigned at random to one of 
two groups— the high verbal content treatment group, or the low verbal 
content treatment group. Eighteen subjects with high verbal aptitudes were 
randomly assigned to the same two treatment groups. Based upon the 
results of a criterion test administered immediately after the treatment, 
which measured the degree to which the students had learned to use 
measurement units, no significant interaction was found. It may be inferred 
that the difference in the performance between the low aptitude group 
and the high aptitude group was the same in the low verbal contciit treat- 
- ment as in the high verbal content treatment (Gilman and Harvilchuck, 
1967). 

A third study of interest conducted at the CAI Laboratory at Penn 
State utilized students from the Williamsport Area Community College 
and a second group of technical students attending the Altoona Campus 
of The Pennsylvania State University, and was designed to examine the 
effects of gradient as opposed to full-response feedback (Hall, Adams, 
Tardibuono, 1967). The students were randomly assigned either to the 
gradient feedback treatment group or the full-response feedback treatment 
group, and their learning of an associative task was compared at the 
conclusion of instruction to examine initial learning, short-term retention 
and long-term retention. No differences were found between the groups 
utilizing the three criterion scores. Johnson and Borman (1967) compared 
the effects of three modes of a CAI unit covering the physics sequence 
designed for vocational technical students with a limited mathematics and 
physics background. These three CAI modes were typeout plus slidcsj 
audio capability only; and a display mode, where students read material 
in a booklet and were shown slides. As measured by a criterion test admin- 
istered immediately after the treatment, each of the three CAI modes 
resulted in a significantly higher achievement than that observed for the 
control group. However, no differences were found in the cffectivness of 
the modes. A replication of the experiment (Johnson and Borman, 1967) 
resulted in the same finding. 

The final Penn State study reported with relevance to vocational and 
technical education was conducted by Wodtke (1965). He investigated 
the interaction between scholastic aptitude and CAI sequence. There were 
two types of sequences programmed; a scrambled sequence (a random 
presentation of the material), and an ordered sequence. This study is 
reported in the section of this review dealing with “Student Characteristics 
Research.” 
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Swcls (1962) reported on the results of six experiments dealing with 
an early model CAI system. The programmed task was for the students 
to learn a series of multidimensional, nonverbal sounds. After examining 
the effects of various types of responses, types of feedbacks, types of 
reinforcement, and step size he concluded that, "these procedures produced 
results that arc comparable to those obtained previously with conventional 
training methods.” Swets and others (1964) report the results of a second 
set of two experiments dealing with the same material on a more ad- 
vanced CAI system. The variable under investigation was the degree of 
control that subjects were given over the sequence of their instruction. 
They concluded that when the subjects were granted control of the train- 
ing procedure no better final performance was observed than when the 
experimenter determined the course of the lesson. 

In summarizing the research in CAI related to vocational and tech- 
nical education: 1) only seven studies were identified; 2) of those seven 
only three involved samples drawn from the vocational and technical stu- 
dent population; 3) of those three using vocational students only two 
utilized programs based on vocationally-related content; and 4) none of 
the instructional programs utilized for experimental purposes was exam- 
ined in terms of occupational validity standards. It should be obvious even 
to the most unsophisticated reader that the ground has hardly been broken 
in examining the application of CAI to vocational and technical education. 
The overwhelming complexity of variables surrounding the interaction 
between the student and the CAI system necessitates a research effort of 
such magnitude to be judged impractical in the foreseeable future. Exten- 
sive financial support essential in conducting such a research effort is 
currently not available, nor likely to become available in the immediate 
future. 

Not unlike other comparable educational developments, in order for 
millions of dollars to be diverted for CAI research evidence of its potential 
for vocational and technical education must be available. In order to pro- 
vide such evidence, however, prior millions must be invested to explore 
the feasibility and effectiveness of an expensive and relatively untried 
system. Unless the ratio of research and development dollars to program 
operation dollars in education changes significantly it is unlikely that these 
initial efforts will soon be possible. It is thus most probable that CAI 
systems in operation for the military and for industrial training will prove 
to have the most immediate impact upon vocational and technical educa- 
tion. 

Computer- Assisted Guidance and Counseling 

In earlier discussion of computer applications and systems approaches 
to instruction, references to the guidance and counseling functions were 
avoided. It may be argued that both instruction and guidance arc designed 
to affect some behavioral change in a learner or client, and thus may be 
conceptualized under the same general rubric. The authors prefer to allow 
a high degree of similarity between the two functions, yet distinguish 
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between them in terms of the more traditional distinction between instruc- 
tional goals and guidance goals (Miller, 1961; Mortensen and Schmuller, 

• 966 ). . , . , 

Cooley (1970) points out that with schools increasing the individual- 
ization of their instruction, teachers are likely to become more specialized, 
and guidance may result as the only function responsible for the individual 
student's education as a whole. In today's world of education, guidance is 
more attuned to the macro-sy.stem of which the student is a part, than the 
micro-system of instruction (Grobman, 1968). Given the future evolution of 
instructional systems approaches to encompass a wider diversity of educa- 
tional activity including the administrative aspect, it is possible to imagine 
this distinction dissolving. 

Arguments proposed for the individualization of the guidance function 
arc quite similar to those used to establish the need for individualizing 
instruction. As Cooley (1970) indicates, the guidance cITort is directed 
toward assisting students to adjust to the school as it is, rather 
toward modifying the school to take into consideration the personalities 
of the students (sec Bloom, 1968 for a comparable approach to instruc- 
tion). What is clear is that the need for individualization is as great in 
the guidance program as in the instructional program, regardless of the 
idealized functions of guidance. 

As a reaction to this situation several efforts to individualize the 
guidance function were begun in the mid-1960's, utilizing computer-assisted 
models, systems approaches, and simulated devices. Since much of this 
initial work was supported by research funds provided through the Voca- 
tional Education Act of 1963, the focus of many of these developmental 
efforts was upon career guidance. 

To guide the reader to summary documents of interest to him, the 
authors present a brief description of six excellent compilations and 
reviews covering each of these significant efforts, none of which were 
published prior to 1969. 

The first of these sources is a compilation of position papers and 
project descriptions edited by Weinstein (1969). This publication was an 
outgrowth of the fourth Symposium for Systems under Development for 
Vocational Guidance, held at Palo Alto in March, 1968. It is composed of 
three parts: 1 ) a focus upon theoretical concerns in the development of 
guidance systems; 2) the technological problems in the implementation 
of guidance systems; and 3) descriptions of a sampling of vocational 
guidance systems which were, at the time of the symposium- under de- 
velopment. These systems included: David Tiedeman's Information System 
for Vocational Decisions (ISVD); IBM's Education and Career Explora- 
tion System (ECES); the American Institutes for Research Comprehensive 
Vocational Guidance System (VGS); the Systems Development Corpo- 
ration's Vocational Counseling System (VCS); the Rochester Career 
Guidance Project (CGP); Impellitteri's Computer-Assisted Career Ex- 
ploration System (CAGE); the University of Oregon Giiidpak System; the 
Willowbrook Computerized Vocational Information System (CVIS); the 
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Palo Alto Computer-Based Course Selection and Counseling System; and 
the Bartlesville Total Guidance Information System (TGIS). 

As arranged by special editor Vriend (1969), a special Imuc (“Coun- 
seling Technology”) of Educationul Technology was published in an 
attempt to cover broadly many of the issues and implications in the de- 
velopment of guidance systems. In addition to the presentation of position 
papers devoted to the varied role of counselors, computers, technolo^, 
and systems analysis in counseling and guidance programs, several descrip- 
tions of specific projects arc included. 

The next of these sources to appear chronologically was a review of 
systems approaches in guidance (Cooley and Hummel, 1969). This review 
was prepared by the authors as one of 10 such reviews to be included in 
the special focus of the Review of Educational Research on guidance and 
counseling. It provides a brief analysis of the systems approach, a review 
of several current system approaches in guidance, and a forecast of future 
directions. The specific approaches discussed arc: the System Development 
Corporation’s Vocational Counseling System; Tiedeman’s ISVD; IBM’s 
ECES; Penn State’s CAGE project; Willowb rook’s CVIS; Magoon’s prob- 
lem-solving procedure; Katz’s System of Interactive Guidance and Informa- 
tion (SIGI); Hummel’s Coordinated Information and Guidance System 
(CIGS); Rochester’s CGP; Krumboltz’s work with Career kits; Boocock’s 
clTorts with the Life Career Game; and AlR’s project PLAN. The authors, 
in summing up the collective potential of these efforts state: “Panaceas 
for guidance arc no more possible tomorrow than they arc today or than 
they were yesterday. It’s a long, hard row to hoc, and the promise of the 
systems approach is to facilitate the hoeing.” 

In chronological order, the fourth review was prepared by Perrone 
and Thrush (1969). The authors present up-to-date developments in the 
field of information-processing systems related to vocational development 
and decision-making. The 18 projects reviewed range from tentative proto- 
type developments to operational programs. Because of the brief abstracts 
presented in the article, the authors provide names and addresses of per- 
sons to contact for further information. 

During the latter part of 1970 an excellent book reporting the current 
progress and’ projected future of computer-assisted counseling was pub- 
lished (Super, et al. 1970). This book “brings together a collection of 
papers, most of them published for the first time, which give a balanced 
pc.’spectivc on developments in computer-assisted guidance and coun- 
seling of students and clients.” The unique features of Computer-Assisted 
Counseling are its discussion of theoretical and practical issues with regard 
to a number of the individual projects and its overview of the current 
status and future directions of these efforts. 

The last of the six sources described herein was guest edited by 
Havens (1970) as a special issue of the Personnel and Guidance Journal 
entitled, “Technology in Guidance.” It includes articles dealing with 
descriptions of ongoing projects and their progress, media in guidance, 
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issues involving technology in guidance, and privacy as related to personal 
data systems. 

Because of th ; sparsity of evidence dealing with the effectiveness of 
these systems, little information is currently available to predict their 
probable direction. The feasibility of computer applications in guidance 
and counseling is attested to by the continuation of two ongoing systems in 
the schools. These arc Willowbrook’s CVIS and Bartlesville’s TGIS. The 
major emphasis of these two approaches arc upon information retrieval, 
educational and occupational exploration, and educational and occupa- 
tional decision-making. 

With the introduction of the computer into the guidance system the 
counselor's role must change. Initial trials of several of the computer- 
assisted programs previously described tend to support the notion that 
counselors arc not prepared to change tlicir current roles. It has been 
stated that the counselors’ reluctance is an outgrowth of the technological 
nature of these systems (Dworkin, 1970). 

Simulation 

Concurrent with the design and adaptation of more complex equip- 
ment and processes in virtually every occupational area, there has been 
increased concern about how persons can be better prepared to work in 
more of these complex environments. Some persons have stated that 
answers to this question may lie in the domain of simulation. Simulation 
is not exactly a new approach to teaching complex behaviors. In com- 
menting on the development of simulators for use in military training. 
Smith and Smith (1966) state that these devices “have developed into 
highly complex training systems that combine automatic programming of 
task sequences and multidimensional recording and control of response 
with dynamic simulation of the task situation.” 

What then does simulation consist of? An interesting and relevant 
definition is provided by This (1970). He states that: 

desirable as it may be, it is not always possible to bring reality 
into the classroom or into the training situation. When this is 
not possible, we try to replicate in the learning experience the 
nearest thing we can to the phenomenon of the real world. It 
docs not matter whether we arc talking about a piece of equip- 
ment or an emotional experience. We call this simulation. 

Gagne’s chapter in Training Research in Education (1962) is especially 
relevant to persons in vocational-technical education. He initially indi- 
cates three things which a simulator docs. First, it attempts to represent 
a realistic situation in which operations may be carried out. Second, it 
provides its users with certain controls over the situation, and third, it is 
deliberately designed to omit certain parts of the real operational situa- 
tion. Gagne goes on to say that: 

a simulator is designed to represent a real operational situation. 
Additionally, it provides for certain systematic controls over this 
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situation. In doing this, it necessarily omits portions or aspects 
of the real situation particularly those of natural variability and 
unpredictability. 

There arc several general references which the reader may examine if 
he desires to pursue the research which has been conducted in this area. 
The previously mentioned chapter by Gagne (1962) synthesizes much of 
the earlier research which has been carried out in the military. A rc- 
scarch'bascd discussion by Smith (1966) is of particular relevance to the 
vocational educator. He details the rca.sons why training devices should 
be used rather than actual equipment, and summarizes some of the cost- 
cITcctivcncss factors which should receive consideration. 

McCowan and Mongerson (1969) provide a definitive review of 
simulation techniques in three broad areas which include gaming, in-basket, 
and mechanical multi-media. They conclude that “although the cost of 
developing comparable simulation units is relatively high compared to 
gaming, in-basket, and group interactive processes, the effectiveness and 
the utility seem high.” 

A more recent discussion by McClelland (1970) deals with the extent 
to which simulation may benefit vocational education. This research 
based article draws upon a number of the studies conducted by the Human 
Resources Research Organization. The author contends that much of the 
work which has been conducted by and for the military services may have 
relevance to simulation techniques in vocational education. 

Research Efforts in Simulation. Several research efforts have been 
directed toward the application of simulation to instruction in vocational 
and technical education. Schnccbcrgcr (1968) explored the use of com- 
puter simulation in teaching farm management. It was reported that the 
decision exercise which was developed is effective in teaching concepts, 
complimenting lectures, and reinforcing previous learning. 

A study conducted by Lattes-Casseres (1968) dealt with the effective- 
ness of teaching home management decision-making concepts through 
simulation. No significant differences were found between the simulation 
approach and more traditional approaches in terms of cognitive and 
effective criteria. It appeared, however, that the simulation method taught 
abstract concepts involved in decision-making as well as the control 
methods. The trend seemed to be for the traditional method to teach 
more effectively at the knowledge level while the experimental or simulation 
method was more effective at the application level. Lack of significant 
differences may have been due to the quasi-experimental design of the 
study. 

The effectiveness of a non-computer business game in teaching post- 
high school business problems classes was conducted by Ashmun (1966). 
The business game approach was compared with a conventional lecture- 
discussion-problem technique. It was concluded that there were no sig- 
nificant differences in the mean scores of the unit achievement tests between 
those who received a business game treatment and those who received a 
lecture-di.scussion-probIem treatment. High ability students in both groups 
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obtained significantly higher mean scores on the unit achievement tests 
than did low ability students. Students who participated in the business 
game reacted in a highly favorable manner to the treatment. 

Rozran (1968) studied the application of a military-type computer- 
based instructional simulation system to a civilian vocational course 
setting! Significant results were achieved in the electronics course for 
students who used the simulator and programmed instruction. However, 
an auto mechanics group that used the simulator did not achieve to any 
greater extent than a control group that did not receive simulator in- 
struction. 

Kelley (1969) developed a farm management game and then evaluated 
what students learned as a result of playing it. Based upon empirical 
evidence it was concluded that making decisions and solving problems 
cooperatively in groups of two or three while participating in an educa- 
tional game docs not result in more cITcctivc learning, and that students 
with school records of low scholastic performance do not demonstrate 
improved performance as a result of participating in an educational game. 
Also, the game which was developed did net appear to improve students 
abilities in farm management areas such as computing labor income and 
decision-making. Most students reacted favorably to the educational game 
in that they found it challenging and enjoyable. 

A computer-based business game for use in high school business- 
related courses was designed and developed by McNair and West (1970). 
The model was programmed in FORTRAN IV and installed on a time- 
sharing computer system. Is was established that the model which was 
developed had the advantages of stability, rationality and controllability, 
although it was found to be too competitive in the market place allowing 
the results of teams’ decisions to be extremely separated. 

The design of a simulated instructional model for occupational edu- 
cation is described by Ogunniyi (1969). The study showed that the focus 
of all educational simulations, regardless of the designer’s orientation, 
was the provision of realistic instruction. Transfer of training is the main 
criterion for deciding what to include in a simulation design. A seven 
process simulated instructional model for occupational education was 
then designed by the author. The functions of each of the processes are 
described and guidelines arc provided for utilizing the model and for 
rectifying disfunctionality that may arise. 

Mccklcy (1970) describes the development of simulation materials 
for use in vocational and technical education leadership training. In 
addition to presenting a brief description of the types of simulations and 
the advantages of using this instructional process, examples are given from 
the leadership training programs which were recently developed by The 
Center for Vocational and Technical Education at Ohio State. 

A simulated vocational training model to educate mentally retarded 
students for employment in the hotel-motel Industry is described by 
McCowan and Mongerson (1969). Although the model is described in 
terms of its specific application to preparing hotel-motel aides, the pro- 
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ccdurc coutd be used as a general curriculum model with other groups 
in a variety of academic and vocational areas. 

Summary . There are several characteristics which the aforementioned 
research studies seem to have. A number of the studies appear to focus 
upon the development of simulation materials for application in a voca- 
tional and technical education setting. Unfortunately, however, few of them 
have actually focused on some of the variables which have relevance to the 
simulation process. An exception to the foregoing is the research detailed 
by McClelland (1970). He describes some of the research being done for 
the military which deals with internal variations in simulation training. 

Of primary concern in the development of simulations is the fidelity 
which a simulator has and the transfer of training which it produces. Fidel- 
ity, or the degree to which a simulation-based training program departs 
from reality, is of utmost importance to the educator. As stated by Biel 
(1962) “for the acquisition of particular skills, what degree of fidelity of 
simulation is required to insure maximal transfer of training to live opera- 
tions?” Biel states that the degree of fidelity required must be considered 
with respect to two aspects of simulation. That is, the training designer 
must decide: 1) what equipment and functions must be simulated, and 
how precise the simulation must be; and 2) how accurately the stimulus 
situations on which training is given must simulate real life? As has been 
seen by the studies which were reviewed, this concern is, in some cases, 
minimal. Hopefully, future efforts will delve more deeply into the impli- 
cations of fidelity of simulation, particularly as they apply to transfer 
of training. 

Other Media Research 

Reported within this section arc research and development efforts 
utilizing media approaches which do not fit under the categories previously 
reviewed — computer-assisted instruction, simulation, or programmed in- 
struction. Only those studies which arc based on an individualized approach 
arc reviewed. For a more thorough coverage of media research and appli- 
cation, the reader may refer to sources such as Ediing (1968), Reid and 
others (1967), and Swanson (1965). 

Multi-Media Approaches. TTie authors reviewed a number of at- 
tempts to devise individualized instructional programs which were char- 
acterized by their designers as multi-media approaches. Because of the 
dangers inherent in using such a term without specifying its character- 
istics, the authors have selected a definition and brief description of the 
term consistent with the approach taken herein. 

The term, multi-media, means a combination of various types of 
media arranged so as to provide appropriate prc.scntational 
capability to realize the objectives and content of a lesson 
through eliciting desired pupil responses. The key factor in a 
properly designed multi-media arrangement is not .simply the use 
of more than one kind of audiovisual device. It is the interre- 
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lationship of the media used in order to capitalize on the dis- 
tinctive characteristics and capabilities of each, making them 
mutually supportive in the creation of a new learning environ- 
ment (Haney and Ullmcr, 1970). 

Rhode and others (1970) have recommended a media configuration 
which could serve as a multi-media base for an individualized instruction 
system. The configuration they propose takes into consideration cost 
factors, support requirements, and instructional flexibility. 

A completely automated multi-media self-study program for teaching 
a portion of electronic solid-state fundamentals has been developed for 
the Air Force (VVhittcd and others, 1966). The media utilized in the 
program include programmed texts, tape-slide audiovisual presentations, 
a cued text, a sound movie, a workbook and an RCA transistor trainer. 
The effectiveness of this program was examined by comparing the 
results of its utilization with a conventional classroom presentation and 
an existing self-study unit available as an Air Force extension course. 
It was found that the multi-media p.-o^ram and the conventional classroom 
presentation were more effective than n- extension course materials. There 
was no significant difference, however, between the multi-media program 
and the conventional presentation. 

A second individualized multi-media program has been designed to 
stimulate polysensory learning by using as many of the student’s physical 
senses as practical (Allen and others, 1968). The available media in this 
system include motion pictures, filmstrips, audio tapes, models, mockups, 
and worksheets to be utilized by the student at an individual student 
station. Three courses have been developed utilizing this approach: auto 
mechanics, auto body and fender repair, and a trade and technical teacher 
education course in individualized muti-media instruction. Preliminary 
findings indicate the probable effectiveness of this polysensory multi- 
media approach. In addition to the Allen effort, four other polysensory 
approaches utilizing a multi-media configuration have been identified. 
Nish (1968) describes the development and testing of a polysensory 
instructional system for teaching knowledges and skills associated with 
the use of expandable polystyrene plastics. The media resources available 
in this instructional system were single concept films, programmed instruc- 
tion books, laboratory experiences and teachers’ guides. The effectiveness 
of this approach was measured by the skill with which 30 selected students 
constructed a foam ice bucket. Nish found that the performance of the 
students exceeded the predetermined minimal standard defined as ade- 
quate, and concluded that self-instructional systems can be effectively 
used to teach all types of knowledges and skills. Hill (1968) applied the 
polysensory approach in the teaching of basic electrical occupational 
competencies. Media resources included a series of tape-slide sequences, 
workbook, and a set of laboratory exercises. Satisfactory performance on 
the criterion test administered at the conclusion of instruction was found. 
The results of an experiment in applying the polysensory approach in 
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the teaching of electric arc welding processes also indicate the practica- 
bility of utilizing this approach for learning even high level perceptual- 
motor skills and knowledge (Sergeant, 1968). Bakamis (1969) has reported 
on the application of the latter three approaches in an isolated school 
district. In discussing the implication of these polyscnsory approaches, 
he concludes that, “It is clearly becoming evident that these systems will 
have far-reaching implications for those not only in vocational-technical 
and related fields, but in all fields concerned with instruction.” 

Three multi-media courses have been developed for use at the Naval 
Academy. The three courses are physics, economics and leadership. The 
media resources are integrated with the total instructional system and 
are under the control of the computer-managed instruction component. 
These media are film loops, texts, slides, programmed instruction material, 
video tape, audio tape, and computer-assisted instruction units. Although 
preliminary validation studies have been conducted utilizing the material 
developed in the three courses, no substantial evaluative data is reported 
(Koontz, 1969). 

Faced with the problem of training an estimated 22,000 specialists 
to operate a newly installed automated data processing system, the Army 
Logistics Management Center developed what they call a multi-media 
individualized instruction package (MMIIP) (Castleberry and Ketner, 
1970). MMIIP consists of student guides, television tapes, programmed 
instruction texts, reference panels, examinations and surveys, computer- 
assisted simulations and an automated record keeping system. It is adapted 
to the learner’s pace, and is portable so that it may be sent to centers 
where trainees are located. 

Media Research with a More Limited Focus. The results of a study 
reported in the “Programmed Instruction” section of this review, designed 
to compare the effectiveness of a self-instructional booklet and laboratory 
demonstrations in teaching selected industrial arts manipulative operations 
favored neither treatment (Hofer, 1963). A second study dealing with the 
effectiveness of self-instructional written materials is reported by Roberson 
(1967). Participating in the study were 187 senior high school distributive 
education students. Students who were assigned to the self-instructional 
treatment scored no better on a criterion test of knowledge and informa- 
tion than a similar group of students taught by the lecture-discussion 
method. Conflicting evidence is found with regard to the effectiveness of 
self-instructional written materials in a study in which 138 junior and 
senior vocational agriculture students participated (McCarley, 1969). Stu- 
dents exposed to a self-instructional guidebook demonstrated a higher 
degree of knowledge and of laboratory performance at the conclusion of 
instruction than a similar group of students who were exposed to the 
lecture- discussion method. 

A study by Edwards (1969) was conducted to compare the results 
of an audio-visual-tutorial laboratory approach with the traditional teach- 
ing method in a selected business machines course. The experimental 
laboratory approach included 22 continuous-loop sound films which were 
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reviewed by the experimental subjects in study carrels. The entenon test 
for the comparison was developed utilizing problems to be worked out on 
each of the machines studied. It was found that the experimental group 
scored significantly higher on the criterion test than students in the control 
croup. Flue (1967) compared the effectiveness of film-loops and 35 mm 
slides in teaching a manipulative skill, and found no differences between 
them. He also investigated the use of an audio component versus no 
auditory component, and the interaction between the audio and the visual 
presentations. There was a significant difference in favor of the group 
assigned to the audio treatment. No significant interaction was noted 
between the audio and the visual. 

In a study conducted by Amelon (1969) welding students were as- 
signed either to a slide-tape method of self-instruction or to a group 
demonstration method for six selected units of the welding course. Mixed 
results are reported— in two units demonstration group performance scores 
were significantly higher; in one unit the slide-tape performance scores 
were significantly higher; and for the other three units there were no 
significant differences detected. 

Bjorkqulst (1965) reported efforts to examine the effectiveness of 
scale models and pictorial drawings in teaching orthographic projection 
principles. Students who utilized scale models or pictorial drawings ac- 
quired the principles with fewer trials than did students who used no 
visual aids. The group which received pictorial drawings was more efficient 
in solving a transfer task than were groups provided with scale models, 
receiving no visual aids, and receiving no instruction. 

A study was conducted in which a group of industrial arts students 
were taught metal spinning by either an individualized slide-tape approach, 
or by an instructor demonstration method. It is reported that the self- 
instructional group did not attain the level of performance of the demon- 
stration students, took more trials, and required more time to produce a 
spun aluminum bowl than the demonstration group (Shcmick, 1965). ^ 

Summary of Research on Other Media . An interesting investigation 
was conducted by Stickell (1963) in which he critically examined studies 
comparing the effects of televised instruction versus direct instruction. 
Important elements of each of 250 studies were compared to the stand- 
ards he proposed as adequate. Over 85 percent of the studies were 
classified as “unlnterpretable,” about 10 percent were classed as "partially 
interpretable,” and only five percent were found to be "interpretable. 
Although no studies specifically comparing televised instruction and direct 
instruction were reviewed herein, the authors contend that it is not 
unlikely that an analysis of the studies reported in this section would 
reveal similar findings. In summarizing the media research precautions 
were thus taken to avoid overstatements. The purpose of including the 
variety of media research reported was to expose the reader to a reasonable 
variety of research currently being conducted in the field with relevance 
for vocational and technics! education. The most restrictive element with 
regard to the selection of media studies was that which related to the 
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criterion that they be focused on an individualized concept of instruction. 
Some evidence was uncovered to justify further application of multi-media 
approaches to vocational and technical education. Additional evaluative 
data is needed, however, in order to be able to firmly establish the effec- 
tiveness of the multi-media concept. Continued efforts by those responsible 
for the Naval Academy program, the ‘polysensory” system, and the 
MMIIP approach could provide substantial evidence within the near future 
to allow tentative evaluative judgments to be made. 

Of the eight studies in this section which were designed to investigate 
the effects of a particular type of instructional medium six were evaluative 
in nature. Of these six investigations: three found no differences between 
the experimental treatment and a “conventional” approach; two found 
differences favoring the experimental media approach; and one found 
mixed results for six units of welding. Such conflicting evidence among the 
studies reviewed provide substantial support for the notion that in order 
for an investigation to provide its maximum contribution it must be con- 
ceptualized as part of a programmatic research effort. The alternative 
is to be faced with the situation that has resulted here — that questionable 
feedback results. 
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INSTRUCTIONAL STRATEGIES 

Instruction has been described previously as the means by which 
educational goals as determined by the curriculum are accomplished 
(MacDonald and Leeper, 1965). Instructional strategies, therefore, may 
be generally viewed as the alternative paths designed to achieve a speci- 
fied set of instructional objectives. The research reported in this section 
primarily focuses upon uncovering the effectiveness of alternative indi- 
vidualized instructional strategies in the learner’s attaining those objectives. 
Programmed instruction, CAI, CMI, and other instructional system ap- 
proaches may be considered macro-instructional strategies. Since they have 
been reviewed in separate sections of this document, no reference will be 
made to them here. This discussion is limited to research dealing with 
learning variables related to individualized instruction such as pacing, 
prompting, feedback, control in error rate, degree of redundancy in 
material, varieties of brancing, etc. It involves what might be called the 
microlevel of instructional designing. Studies have been selected for inclu- 
sion on the basis of their implications for vocational and technical educa- 
tion. 

Pacing 

Studies are reported herein which examine the rate at which instruc- 
tion proceeds, that rate being determined either by the student at his own 
pace, regulated by an automated device, or fixed by some external source. 

Fixed-Paced versus Self-Paced Instruction . Heyel (1967) reports the 
results of an experiment to compare a self-paced instructional unit with a 
fixed-paced unit covering the same material. The unit was an eighth grade 
industrial arts programmed sequence designed to teach youngsters to pre- 
pare and lock-up a single type form. Written and performance tests were 
administered at the conclusion of instruction after two and six weeks. It 
was found that the group of eighth grade boys assigned to the fixed-paced 
treatment performed no differently on the criterion measures than the 
group of eighth grade boys assigned to the self-paced treatment. It was 
also found that boys in each of the two groups performed significantly 
better on the criterion measures than a third group who received no 
instruction but took the criterion tests. Another comparison between self- 
paced and fixed-paced instruction is reported by West (1968). Two 
hundred and forty high school students at four levels of typewriting skill 
were assigned to either a self-paced or a fixed-paced unit designed to 
increase speed and accuracy in accomplishing ordinary typewriter copy- 
work. He found that neither speed nor number of errors differed between 
the two groups when the criterion test was administered immediately prior 
to the instructional treatment. The results of two additional experiments 
comparing the effects of self-paced versus fixed-paced also confirm the 
lack of a significant difference in performance results (Anderson and 
others, 1955; Nystrom and others, 1955). The criterion measure in each 
of these experiments was a self-paced psychomotor performance task. 

Other Pacing Studies . In a study designed to compare the effects of 
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a self-paced instructional unit with a traditional lecture-demonstration 
unit to teach accepted safety practices in operating woodworking machines, 
it was found that the former resulted in a significantly higher performance 
for a sample of undergraduate males in industrial education (Beckham, 
1969). The criterion measure involved a composite rating by three judges 
who viewed a video tape of each student’s operation of the equipment 
immediately following the instructional treatment. Another significant 
finding was the saving of instructor’s time during the self-paced program 
so that he could be free to work with individual students. Bushnell (1963) 
also compared the effect of self-paced instruction with conventional instruc- 
tion. The task was to teach selected introductory concepts in industrial 
electronics to a group of 96 journeymen electricians. Their performance 
at the conclusion of instruction and their satisfaction with the course to 
which they had been assigned - were the criterion variables. The elec- 
tricians were assigned to one of three instructional treatments: a self-paced 
individualized instruction unit with branching; the same self-paced unit 
with an opportunity to discuss problems and issues that may have been 
raised during the instructional experience with a qualified instructor; and 
a conventional classroom arrangement. No significant differences between 
the three groups in their criterion performance were reported, although 
the group assigned to the self-paced unit with an opportunity to discuss 
questions with the instuctor was more highly satisfied with the experience 
(Bushnell, 1963). 

Two methods of fixed-paced instruction were investigated by Kress 
and Cropper (1965). A fixed-paced unit with prompting (providing the 
correct answer for the student) was compared to differential fixed-pacing 
for homogeneous groups. The students who were placed in the homo- 
geneous groups performed significantly better than the students who re- 
ceived prompting. 

Studies Examining Other Learning Variables 

The number of studies identified by the authors which systematically 
examine learning variables, and at the same time have direct implication 
for vocational and technical education was quite small. The rather crude 
grouping of these studies as presented in this section was therefore neces- 
sitated by the limited range of the field that is covered by those studies. 

Prompting as Compared to Confirmation. Engelbart and Sorensen 
(1965) compared the effects upon learning of a variety of prompting con- 
ditions and confirmation conditions. The task was to train subjects to 
operate a five-key chord keyset for transmitting letters and numerals. 
Three prompting conditions (automated visual, automated tactile, and non- 
automated), a confirmation condition, and a no-confirrnation condition 
were designed. It was found that confirmation utilized in a selected 
training program resulted in a significantly higher criteria performance 
than any of the prompting treatments. It was also found that visual prompts 
resulted in better performance than tactile prompts in both speed and 
accuracy. Two additional studies support this finding. The first investiga- 
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tion was an attempt to measure the effectiveness of selected instructional 
treatments in training subjects to use a symbolic coding language and the 
basics of computer programming (Seidel, 1968). Competency of the sub- 
jects was measured at the conclusion of instruction and four weeks later. 
Three independent experiments were conducted dealing with the comparison 
of the prompting condition and the confirmation condition. In each of 
the experiments the confirmation of responses led to significantly higher 
performance than the prompting treatment. Csanyi, Glaser and Reynolds 
(1964) conducted a study which resulted in a similar finding. The authors 
did identify one study in which the differences between prompting and 
confirmation were found to be nonsignificant (Weisz and McElroy, 1964). 
It is inferred that the difference between their results and previous findings 
may be due to the nature of the tasks to be performed, and the procedures 

which they employed. . . . , . , 

Scanlon and Tom (1967) conducted an investigation in which they 
randomly assigned a group of ninth grade first-year vocational agriculture 
students to one of three instructional conditions. These treatments were: 
a programmed unit, the unit plus blocked review, and the unit plus spaced 
review. The students were tested for amount learned at the conclusion 
of instruction and 30 days later. Although the treatment providing blocked 
review proved better than the treatment with spaced review, neither of 
the review conditions led to significantly greater learning than the pro- 
grammed instruction unit itself. No differences were found between any 
of the treatments on the test for retention. 

Sprenger (1970) investigated the effects of block size and the use of 
mnemonic aids in learning the basic Gregg shorthand alphabet. He as- 
signed 100 secondary school students to one of five block size conditions 
and to either a mnemonic aid treatment or to a non-mnemonic aid treat- 
ment. It was found that those students receiving mnemonic aids required 
fewer trials to reach criterion immediately following instruction than those 
students who had not received those aids. That difference was not found 
in the retention test given 48 hours after the instruction. No significant 
effects were attributable to block size. A study related to the previous 
report was conducted by Briggs, Naylor and Fuchs (1962). It was de- 
signed to investigate pure-part, progressive-part, simplified and \vhole 
training techniques and their effectiveness in teaching a three-dimensional 
tracking task. It was found that in the simpler tasks the whole method 
was superior. Some evidence was revealed, however, indicating that the 
more complex the task to be learned, the higher the relative efficiency of 
the progressive-part method. 

Five versions of an individualized program on medical terminology 
were evaluated by Valverde and Morgan (1969), to determine the effect 
of redundancy on learning. The 440 subjects involved in the experiment 
were randomly assigned to one of five groups; 1) a 274 frame linear pro- 
gram, 2) a 160 frame linear program, 3) an 83 frame linear program, 
4) a narrative test, and 5) 4-inch by 6-inch summary cards. Subjects in 
treatment groups 1 and 2 scored significantly lower on the criterion tests 
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than those in groups 3, 4, and 5. There were no differences between groups 
1 and 2 and between groups 3, 4, and 5. The investigators conclude that 
the repetition included in the longer programs (Groups 1 and 2) may 
detract from the effectiveness of self-instructional programs. Conflicting 
findings were reported by Dawson (1969) regarding the relationship 
between redundancy and effectiveness. Dawson, in comparing the effec- 
tiveness of a high redundancy and a low redundancy program found that 
students exposed to the former treatment scored significantly higher than 
those students exposed to the latter treatment. 

Seidel (1968), in addition to comparing the prompting condition 
and the confirmation condition as reported previously, examined the 
effects of verbalization and the effects of variety of practice on perform- 
ance. The three verbalization treatments were: subjects in the first group 
were required to write in the entire rule applicable to the problem; stu- 
dents in the second group were required only to write a mnemonic; and 
students in the third group were required to write nothing. The two prac- 
tice treatments were a variety treatment and a repetitive treatment. Meas- 
ured by the criterion test to determine the degree to which students had 
acquired ability in solving computer programming problems, the group 
required to write a mnemonic for the rule scored significantly higher than 
the group who were required to write nothing, both of which scored 
significantly higher than the group who were required to write the entire 
rule applicable to the problem. It was also found that those students who 
were exposed to a variety of practice exercises scored significantly higher 
on the criterion measure immediately after the conclusion of instruction 
than those students who were exposed to repetitive practice exercises. 
Retention tests given at the end of four weeks revealed the same results. 

Briggs (1962) conducted an experiment to determine the effect of 
negative feedback as compared to positive feedback in the acquisition 
and transfer of skill. He found that feedback given when the subject was 
in error resulted in significantly higher levels of performance than when 
feedback w"s used to indicate that the subject was performing acceptably. 

Landecker (1969) conducted a study in which two groups taught 
by a conventional method were compared with the performance of two 
groups exposed to delayed-response learning guides. The unit was selected 
from the field of mechanics. It was found that the mean score on a 
mechanics achievement test immediately following instruction was sig- 
nificantly higher for the two delayed-response groups than it was for the 
two conventionally taught groups. There were no significant differences 
between the attitudes of the students taught by the different methods. 

Mirabella and Lamb (1966) investigated several aspects of an adap- 
tive training approach developed for use by the Navy. They report the 
results of adaptive versus nonadaptive training upon performance in a 
visual target detection task. It was found that increasing the complexity 
of the display material during the course of training, and at the same time 
requiring subjects to actively respond to the material, was a more effective 
approach than maintaining a constant level of display complexity, and at 
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the same time requiring only passive viewing of the displays. It was also 
found that a high error rate during the course of ^ 

necessarily detrimental to performance after training. Kelley ( ) 3 

Matheny (1969) also discuss various aspects of adaptive training.^ Kelley, 
in an article entitled “What is Adaptive Training?” defines it as ‘ training 
in which the problem, the stimulus, or the task is varied as a function ot 
how well the trainee performs.” “The basic requirement for ad^aptive 
training systems is the need for automatically changing training task ditti- 
culty” (Matheny, 1969). During the course of instruction in the adaptive 
training approach the material presented to a student at a particular time 
is adjusted automatically to conform to the measured level of the student s 

skill. 



Summary 

In examining the effects on student performance of several learning 
variables such as manner of pacing, varieties of confirmation and Pr°i^P|- 
ing, type of review condition, block size, degree of redundancy, and feed- 
back the studies reported in this section revealed a number of consistent 

results. 

1. Those studies comparing self-paced and fixed-paced instructional 
units found no differences in their effect upon students’ criterion 
performance. 

2. The confirmation condition resulted in significantly higher student 
criterion performance when compared with several prompting 
conditions. 

3. Significant differences in students’ criterion performance between 
treatments found immediately after instruction tended to dissolve 
when students were tested for retention. 

Conflicting results were found in attempting to summarize the effects 
on students’ criterion performance of: self-paced instructional units com- 
pared with conventional instruction; varying degrees of redundancy in 
instructional materials; and blocked review as compared with spaced 
review. 

The only attempts reviewed to systematically investigate the effects 
of varying instructional strategies were found in the programmatic research 
contracted for the military. It is likely that such research efforts will have 
a significant impact upon research in vocational and technical education 
in the near future. 
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INSTRUCTIONAL SYSTEMS APPROACHES 

An instructional system may be defined as “an integrated set of media, 
equipment, methods, and personnel performing efficiently the functions 
required to accomplish one or more . . . objectives” (Smith, 1966), It 
may be argued that our current educational and training programs have 
been developed on a sysf;matic basis. Each person or group responsible 
for developing an educational or training program must operate by some 
system or other (Odiorne, 1965). Instruction in this sense is and always 
has been systematic (Bern, et al, 1965). What, then, distinguishes instruc- 
tional systems from those systematic efforts to develop instructional pro- 
grams in vocational and technical education for the past 60 years? Leh- 
mann (1968) describes eight steps in the development of an instructional 
system. These are: 

1. Need — the education/training problem; 

2. Objectives — measurable learning goals; 

3. Constraints — restrictions or limitations; 

4. Alternatives — candidate’s solutions; 

5. Selection — choice of best alternative; 

6. Implementation— pilot operation of the chosen solution; 

7. Evaluation — measurement of results obtained against originally 
stated objectives; and 

8. Modification — the change of the system to current for the defi- 
ciencies noted. 

Lehmann’s list of steps in the design of instructional systems is quite 
similar to that proposed by Smith (1966): 

1. Preparing the training objectives, 

2. Sequencing the objectives of the system, 

3. Identifying required functions, 

4. Selecting components and procedures, 

5. Analyzing cost-effectiveness, 

6. Coordinating components and procedures, and 

7. Evaluating the system. 

The steps listed by Smith do not include the identification of the educa- 
tion/training problem nor the modification of the instructional system. 
Smith takes these into consideration, however, in his presentation of an 
instructional system model. This model includes the job as a starting point 
for the training problem, and incorporates the evaluation of the system 
into its redesign. He views systems as developmental and changing, and 
perceives the function of evaluation as an aid in the continuous modifica- 
tion of the instructional system. Smith’s step number 5, the analyzing of 
the cost-effectiveness of the system, need not be viewed as an integral 
part of the instructional design. It is, of course, an important consideration 
for those responsible for operating training or educational programs. 

The systems approach to instruction employs a systematic structuring 
of curriculum material from the learner’s point of view, resulting in a 
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logical, functional, step-by-step path whereby the learner proceeds from 
his personal starting level through accomplishment of previously set per- 
formance objectives (Lehmann, 1968). McFann (1969) describes the 
implication of this process in terms of interrelationships between ability 
levels, type and complexity of content, organization and sequencing, ma- 
terial, method and media of instruction, motivation, and management. 

One set of specifications for instructional systems which focuses on 
these interrelationships and accounts for the evaluation and modification 
of the system has been proposed (Ikenberry, 1970): 

1. The instructional system shall be independent of time restric- 
tions in the sense that individuals shall be able to progress at 
their own rates, shall be able to begin the learning sequence 
when it seems educationally desirable and shall be able to con- 
tinue the instructional process until mastery has been achieved. 

2. The objectives of instruction shall be relevant to the immediate 
and long-term needs of the learner, and the learner shall be 
cognizant of this relevance. 

3. Educational objectives shall be stated in unambiguous terms 
which make clear the intellectual competencies to be developed 
by the learner. 

4. The instructional system shall maximize student active involve- 
ment in the learning process. 

5. The instructional system shall provide accurate, timely and 
formative feedback to the learner regarding his progress toward 
learning goals. 

6. The instructional system shall be designed to maximize the prin- 
ciples of positive reinforcement and eliminate or minimize those 
aspects known or suspected to be aversive to the learner. 

7. The instructional system shall insure appropriate sequencing of 
learning experiences, shall be capable of diagnosis of learner 
deficiencies and adjust the instructional sequence appropriately. 

8. The instructional system shall solicit reliable and timely informa- 
tion on individual student learning progress and shall make 
adaptations appropriate to the individual learner. 

9. In the development of instructional goals and processes, the 
instructional system shall take into account the total environ- 
ment in which the student learns. 

10. The instructional system shall have a recognizable “style”, a 
cognitive structure sufficiently obvious to provide a basis for 
student choice among institutions, to provide meaning or rele- 
vance to learning, and to encourage continuous commitment to 
learning throughout life. 

Two general types of instructional systems with relevance to voca- 
tional and technical education were identified. Learner-centered instruction 
(LCI) has been developed by personnel from the Air Force Human 
Resources Laboratory. The second general type of approach has been 
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under development in a number of locations throughout the country and 
may be referred to generally as computer-managed instruction (CMI). 

Learner-Centered Instruction 

LCI is an instructional system designed by the Air Training Com- 
mand in which a student is assigned behavioral objectives and proceeds 
at his own rate, with minimum assistance from an instructor, until he can 
perform those objectives (Bumstead, 1969; Valverde, 1969). The first 
course to be developed as part of the LCI system was an electronics course 
appropriate for airmen preparing for specific duties as mechanics or 
technicians working on a particular weapons system. The course included 
the use of several instructional media and devices, programmed books, 
teaching machines, and task simulators (Pieper, Folley, and Valverde, 
1969b). A special job performance test was developed as a criteriori 
measure in evaluating the success of the LCI course. It was based upon 
tasks derived from the behavioral description of the actual job, and con- 
tained three parts: 1) operational checkout, 2) troubleshooting, and 3) 
auxiliary task performance (Pieper, Folley, and Valverde, 1969a). The 
effectiveness of this LCI course as compared to the conventional Air Force 
course to train a similar type worker was explored. Those completing their 
respective courses were compared with regard to their job performance 
immediately following completion, job performance after five months, 
student acceptability, and instructor reactions. It was reported (Peiper, 
Swezey, and Valverde, 1970) that the performance for the LCI group was 
significantly greater than for the conventional group, that the cost of the 
LCI course was substantially lower than that of the conventional course, 
and that the courses were equally acceptable to the trainees. 

Computer-Managed Instruction (CMI) 

According to Baker (1971) the outgrowth of the computer-managed 
instructional system development was due to the effort of a number of 
researchers to systematically individualize instruction without involving 
CAI. It becomes immediately clear to attempting to individualize an 
instructional program that the most crucial problem is one of management. 
The major functions of a CMI system are those of scoring seat work, 
scoring test papers, recording scores, creating descriptions of pupils based 
on their scores, and keeping track of the instructional materials a particular 
student has used. Given these mechanical tasks, it is the larger goal to 
provide the teacher with the tools of management (Baker, 1971). The 
distinction between CMI and CAI is the focus of the former on instruc- 
tional functions and of the latter on the management of instruction (Baker, 
1971; Koontz, 1970). Viewed in this manner, programmed CAI units may 
be considered to be part of the CMI system. The Naval Academy project 
as described below does, in fact, involve the use of the CAI units as one 
of several instructional procedures integrated within a computer-managed 
instructional system. Baker (1971) in reviewing several computer-man- 
aged instructional systems indicates their four major functions: test scoring, 
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diagnosing, prescribing, and reporting. Five examples of CMI systems 
were identified by these reviewers which have some relevance to voca- 
tional and technical education. These are: 1) the Naval Academy project 
as mentioned previously; 2) the Memphis Naval Air Technical Training 
Project; 3) Project PLAN (Program for Learning in Accordance with 
Needs) developed at the American Institutes for Research; 4) IPI (Indi- 
vidually Prescribed Instruction) developed at the University of Pittsburgh, 
Center for the Study of Learning; and 5) Project ULTRA (Unlimited 
Training for All), developed at the New York Institute of Technology. 

The development of a CMI system at the Naval Academy emerged 
from the necessity to systematize the management function in utilizing 
CAI equipment and a multi-media course development effort. As indi- 
cated previously by B^ker (1971) the problem of managing instruction 
is broader than the instructional problems faced in CAI. Koontz (1970) 
describes the Naval Academy CMI effort as it relates to the development 
and field testing of a number of technical-type courses. The computer 
functions identified in this system are: data acquisition, data interpretation 
(scoring of multiple-choice tests and item analyses), prescription, sched- 
uling, and validation/evaluation. 

A CMI system developed at the Memphis Naval Air Technical 
Training Center is aimed at reducing training costs (Johnson, 1967). The 
rationale in developing this training system was the selection of one or 
two alternatives in individualizing instruction. One may either hold time 
for training constant and allow quality to vary, or hold quality constant 
and let the training time vary. Since the latter was selected as one of the 
constraints on this CMI system, the objective was ^to reduce training time 
as much as possible while holding to a constant minimal quality level. The 
CMI system as developed resulted in reduced training time by: 1) alter- 
nating paths through instruction; 2) eliminating unnecessary instruction; 
3) avoiding repetition of what some students already know by pretesting; 
and 4) having the students take greater advantage of self-instructional 
materials. 

Project PLAN was developed by the American Institutes for Research 
as a means of correcting deficiencies in our educational system as identi- 
fied by their Project TALENT efforts. PLAN consists of five components 
(Flanagan, 1968): 

1. A comprehensive set of educational objectives grouped into 
modules. 

2. Teacher-learning units which prescribe materials to be used by 
students in obtaining these objectives. 

3. Evaluation procedures whereby post-testing at the completion 
of a module and the measurement of long-term objective achieve- 
ment is determined. 

4. Guidance and individual planning materials. 

5. A medium-sized computer to perform the mechanical tasks of 
test scoring, maintenance of file, recording student results on the 
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teacher-learning units and keeping track of the student’s progress 
in his guidance and planning procedures. 

The relevance of the PLAN approach to vocational and technical 
education is viewed more readily in the context of the Project ABLE 
effort. The approach to the individualization of instruction utilized in 
Project ABLE, also conducted by the American Institutes for Research 
(Ullcry and Micastro, 1970), is taken from the same computer-managed 
base as the PLAN approach. Primarily envisioned as a curriculum effort 
in vocational technical education. Project ABLE incorporates an instruc- 
tional strategy involving an instructional management system with all the 
features as described in the PLAN system. 

The Individually Prescribed Instruction (IPI) project at the Univer- 
sity of Pittsburgh incorporates a CMI system as part of its approach. As 
described in a recent progress report (Research for Better Schools, 1969), 
IPI includes: placement testing and prescription technology, pretesting, 
instructional materials built around specified objectives, periodic progress 
reports of an individual’s progress, a post-test to measure overall mastery, 
and a management system for teachers. IPI is being tried out initially at 
the Oak Leaf Elementary School in the Baldwin-Whitehall School District 
of Pennsylvania. 

A computer-management system is being developed at Oak Leaf 
School to help research and implement individualized instruc- 
tion. Its purpose: matching relevant measures of student per- 
formance with appropriate curriculum methods and materials to 
assist ^^achers in preparing instructional prescriptions for each 
student (Nationa’ School Public Relations Association, 1968). 

Project ULTRA developed by the New York Institute for Technology 
is designed for the training of engineering technicians. It involves: diag- 
nosis, progress checks, prescription, and overall evaluation (Schure, 
1965). As part of its diagnostic feature this CMI approach incorporates 
the results of an occupational inventory, giving additional guidance in- 
formation. 

Baker (1971) in his summary of various CMI projects concludes: 

As is the case with CAI, the promise of CBIM (Computer-based 
instructional management) systems far exceeds the present ac- 
complishments. The present systems are rudimentary, provide 
the teacher precious little management assistance and are avail- 
able on a very limited basis. Primary attention has been given 
to getting such systems up and running, and their role as a man- 
agement tool for the teacher has been nearly ignored. Hope- 
fully, now that the feasibility of CBIMS has been demonstrated, 
attention can turn to the reason for their existence. 

Based on his contact with the Naval Academy project, Koontz (1970) 
reaches a similar conclusion. 



Other Instructional Systems Applications 

Detroit Northern Systems Company has developed a training system 
approach for the hard-core unemployed. The system is described by which 
training objectives are achieved “through an interplay of program com- 
ponents which include training lines of tool stations, back-up classes which 
precede the tool line, remedial classes. . . ., and the Social Skills Seminar 
, . .” (Harrison, 1970). Instructional systems design with implications 
for industrial and technical education was the focus of a recent article 
appearing in the Journal oj Industrial Teacher Education (Frantz, 1970). 
Implications for industrial and technical education at the elementary, 
secondary, and post-secondary levels were presented as a significant out- 
growth of the instructional systems approach. 

As a result of numerous instructional systems development efforts 
throughout this country several types of instructional packages have been 
produced as components. For examples of such use in experimental pro- 
grams see Esbensen (1968) and Edling (n.d.). A study was conducted 
in 1965 to measure the effectiveness of a mathematics package for the 
occupational training of depressed area students. It was reported that 
students in the group exposed to the mathematics package scored signifi- 
cantly higher on the criterion test immediately upon completion than a 
similar group exposed to the conventional treatment (Bushnell, 1966). As 
a result of the study it was recommended that an additional five semester 
units of instruction in subject areas essential to vocational education pro- 
grams be produced and validated. 

Summary of Instructional Systems Development 

Several instructional systems development efforts which may poten- 
tially be applied to vocational and technical education were identified. 
These efforts are in varying stages of development, the most advanced 
of which appears to be in the learner-centered instruction approach. Avail- 
able evaluative data describing outcomes of field trials utilizing LCI mate- 
rials suggest its desirability in terms of effectiveness, cost, and acceptance 
by students and instructors. Essential components of the LCI system 
include the specification of job tasks as initial instructional objectives, and 
the measurement of job performance as an evaluative criterion. In terms 
of the instructional objectives and evaluative criteria typically desired of 
vocational education programs, the LCI approach would need only slight 
modification to be applied to selected vocational and technical areas. 

Some may argue that instructional systems evolving from an educa- 
tion base are more appropriate for applying to vocational and technical 
areas than LCI which has a military training base. Given the encouraging 
results of preliminary trials of LCI it is argued here that no systems 
approach in education has demonstrated such results. As Loughary 
(1968) points out, “although the instructional systems approach has a 
great potential to improve education, its current efforts are sporadic, unco- 
ordinated, and lack research support.” 
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The design of instructional systems is not an easy task, nor does it 
guarantee learning. It is not an easy task because it’s a task that never 
is completed. It’s a continuously evolving, dynamic process of develop- 
ment, evaluation, and redesign (Koontz, 1970c). Its potential for voca- 
tional and technical education is so appealing, however, that the time, 
effort, and scientific precision involved in its design is a small cost to 
pay based on its potential payoff. 
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Observation 6. The samples utilized in much of the research reviewed 
in this document were not composed of the type of student to which we 
desire to generalize the results. Given that the primary purpose of indi- 
vidualizing instruction is to meet the educational or training needs of the 
whole spectrum of our student population, little effort appears to have 
been made to adequately represent that range. 

Observation 7. The emphasis upon the development of actual work 
performance skills in vocational and technical programs has not been 
sufficiently recognized in most of the research reviewed. The preponder- 
ance of studies posed rather artificial, easily measured criterion variables 
upon which to measure instructional effectiveness. 

Observation 8. An overabundance of studies dealt with the differential 
effectiveness of one or more experimental treatments and a convention or 
traditional instructional method. In spite of the considerable criticism 
leveled upon .such research (Bloom and others, 1971; Briggs, 1968; Reid 
and others, 1967; Sullivan, 1969; and Travers, 1962), and its failure to 
provide meaningful and interpretablc results, it still seems to persist. 

Observation 9. Because of the extreme importance of individual stu- 
dent differences to the design of individualized instruction, the authors 
chose to report in a separate section studies which accounted for selected 
student characteristics in some way. Several studies of this type were 
identified, most of which accounted for aptitude differences, but avoided 
affective differences (such as attitudes, motivation, interests, or values). 

Observation 10. The research reviewed was generally simplistic in 
design, avoiding the examination of interactive effects such as instructional 
treatment by type of objective, or instructional treatment by level of 
student ability. Doctoral studies particularly demonstrated this tendency 
toward the univariate approach. 

Observation 11. The only significant attempts to replicate research 
were found in studies conducted for the military. The lack of replication 
is at lease partially due to the failure of most studies to adequately 
describe the instructional treatments being tested. 

The great variety of research and developmental activities identified 
by the authors as relevant for Inclusion in this review is strong evidence 
that individualized instruction is perceived to have a great potential for 
improving vocational and technical education. Other circumstances leading 
to an optimistic view of the future are the relatively short period of time 
during which the systematic study of individualized instruction has been 
going on, and the short history of research in vocational and technical 
education. 

Although several studies have been reported in previous sections of 
this document which support the effectiveness and feasibility of individ- 
ualized instruction when utilized in vocational and technical programs, the 
tangible accomplishments of research and development activity in this 
field are extremely difficult to Identify and describe explicity. Their con- 
tribution appears to be as precursors of things to come rather than as 
hard, established gains. With a goodly supply of trained professionals 
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working on the design of individualized instruction approaches, and ample 
evidence as to its potential in improving vocational and technical educa- 
tion, the future appears bright. 

Recommendations for Research and Development 

1. Programmatic research and development efforts are needed to 
improve the current status of individualized instruction in vocational and 
technical education. Teams of researchers, curriculum specialists, instruc- 
tional technology specialists and teachers must be formed to embark upon 
research and development efforts geared specifically to vocational and 
technical education. Viewed as a total system, instruction can be effec- 
tively designed only by the cooperative efforts of practitioners and re- 
searchers. The task is too complex and the system is too dynamic for 
implementation to be set apart from research. Householder (1968) calls 
for a concerted effort toward problem areas like individualized instruction 
which are of widespread concern, and Taylor and Christensen (1967) 
urge a profession-wide research and development program to assess the 
optimal applications of media to vocational and technical education. 
Global attempts such as these are essential in moving toward realization 
of the potential individualizing instruction has in our field. 

2. Related to the necessity for wide-scale attacks upon research and 
implementation problems is the necessity to acknowledge and utilize se- 
lected ideas and devices initially developed for military use. The consider- 
able overlap between vocational and technical education and military 
technical training suggests that the large amount of research and develop- 
ment activity conducted for the military may hold substantial transfer- 
ability to civilian counterparts (Briggs, 1967). Some success has already 
been noted in isolated attempts to acconiplish this transferral (Straubel, 
1971). 

3. The increasing number of doctoral theses being produced provides 
vocational and technical education with a potent resource in launching a 
large-scale research and development effort. We cannot afford to disre- 
gard the potential contributions of these young scholars if a serious attempt 
is to be made in designing effective instructional packages for use in 
vocational and technical education. However, these doctoral students can 
become part of the team only through the stimulation of university faculty 
who are members themselves. One doctoral study which evolves from a 
programmatic research and development effort, and becomes a significant 
part of that effort, contributes an infinitely greater amount to the field 
than a study conceived and conducted in isolation. 

4. Research focusing upon selected aspects of individualizing instme- 
tion is essential in the improvement of vocational and technical education. 
Based upon research of that type reviewed in this document, the authors 
contend that certain qualities of future research efforts need to be em- 
phasized. 
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a. In the formulation of instructional objectives and the means de- 
signed to measure them, emphasis should be placed upon work 
performance criteria. 

b. Interactive effects of instructional treatment with other factors, 
particularly student affective characteristics, need to be examined. 

c. Samples utilized in studies exploring the effects of individualized 
instruction must be drawn from the population to which the 
results will be generalizable. 

d. In order to provide for the possibility of replicating an experi- 
mental study, a thorough description of the instructional treat- 
ments examined must be presented. 

e. Experimental research replicating prior studies is a scholarly ac- 
tivity, and is highly desirable. 
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